00000001:02000400:3.0F:1787075685.261022:0:2965:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787075707.110206:0:3187:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1787075709.411332:0:3248:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 563 MB/s 00000001:01000000:0.0F:1787075709.664598:0:3248:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 683 MB/s 00000001:01000000:3.0:1787075709.922879:0:3248:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5387 MB/s 00000020:02000000:1.0F:1787075710.643083:0:3280:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.57_1_g711d631 00000400:02000000:1.0:1787075711.430345:0:3295:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.150@tcp [8/256/0/180] 00008000:02000000:2.0:1787075715.494035:0:3444:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787075771.080156:0:5248:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787075780.376975:0:5832:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787075780.376981:0:5832:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787075780.377511:0:5832:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ede08f00 00000080:02000400:2.0:1787075780.377524:0:5832:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787075780.382093:0:5832:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787075780.382107:0:5832:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787075780.382149:0:5832:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000c57f8c10) 00000020:00000080:2.0:1787075780.382231:0:5832:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787075780.399960:0:5832:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787075780.400489:0:5832:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787075780.434410:0:5832:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787075780.434459:0:5832:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787075780.434482:0:5832:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787075780.437769:0:5832:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787075780.437810:0:5832:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787075780.438226:0:5832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787075780.438235:0:5832:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787075780.438246:0:5832:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x859911ad6869f1b5 00000020:01000004:2.0:1787075780.438253:0:5832:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787075780.438258:0:5832:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787075780.438263:0:5832:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ede08f00 from MGS 00000020:01000004:2.0:1787075780.438267:0:5832:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787075780.438277:0:5832:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000007b32dbb6) 00000020:00000080:2.0:1787075780.438289:0:5832:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787075780.438354:0:5832:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ede08f00 from MGS, refs=2 00080000:01000000:2.0:1787075780.438360:0:5832:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787075780.438367:0:5832:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x859911ad6869f1c3 00000100:00100000:2.0:1787075780.438474:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787075780.438622:0:5832:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787075780.438629:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787075780.441867:0:5832:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787075780.441900:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787075780.443341:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787075780.443510:0:5832:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787075780.443515:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787075780.444488:0:5832:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787075780.444496:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787075780.445095:0:5832:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787075780.445103:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787075780.450453:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075780.450461:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075780.450463:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075780.450974:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075780.450977:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075780.450979:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787075780.452102:0:5832:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787075780.464776:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787075780.701925:0:5832:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3423 MB/s 00000001:01000000:3.0:1787075780.954790:0:5832:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2881 MB/s 00000001:01000000:1.0:1787075781.206355:0:5832:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 442 MB/s 00000001:01000000:0.0:1787075781.457536:0:5832:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 593 MB/s 00080000:10000000:2.0:1787075781.482291:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1787075781.511929:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787075781.517071:0:5832:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787075781.517089:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787075781.517091:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787075781.520073:0:5843:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787075781.521098:0:5832:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787075781.521217:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787075781.521799:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787075781.521912:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787075781.522515:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787075781.522718:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787075781.522725:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787075781.526617:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787075781.532954:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787075781.533795:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787075781.533804:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787075781.537744:0:5832:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787075781.537769:0:5832:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.150@tcp' 00000020:01000004:3.0:1787075781.537771:0:5832:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787075781.537820:0:5832:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.150@tcp (typ=mgc) 00000020:00000080:3.0:1787075781.537842:0:5832:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.150@tcp (00000000de40894a) 00000020:00000080:3.0:1787075781.537857:0:5832:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787075781.537977:0:5832:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d551216a@MGC192.168.204.150@tcp: add connection 192.168.204.150@tcp at head 00000100:00080000:2.0:1787075781.538293:0:5848:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:3.0:1787075781.538994:0:5832:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.150@tcp-0 is initialized 00000040:01000000:3.0:1787075781.539002:0:5832:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787075781.560088:0:5849:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787075781.560688:0:5832:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.150@tcp (uuid f837e7e9-66a9-4dbd-86cd-a110c11486d7) 00000020:00000080:2.0:1787075781.560717:0:5832:0:(genops.c:1406:class_connect()) connect: client f837e7e9-66a9-4dbd-86cd-a110c11486d7, cookie 0x859911ad6869f1d1 00000100:00080000:2.0:1787075781.560731:0:5832:0:(import.c:510:import_select_connection()) MGC192.168.204.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787075781.560738:0:5832:0:(import.c:624:import_select_connection()) MGC192.168.204.150@tcp: import 00000000d551216a using connection 192.168.204.150@tcp/0@lo 00000100:00100000:2.0:1787075781.560791:0:5832:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000042d82e46 x1873884700737664/t0(0) o250->MGC192.168.204.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787075781.560891:0:5832:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f837e7e9-66a9-4dbd-86cd-a110c11486d7->MGS 00000020:01000004:2.0:1787075781.560911:0:5832:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787075781.561020:0:5832:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787075781.561034:0:5832:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000b79bb76b) 00000020:00000080:2.0:1787075781.561049:0:5832:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787075781.563054:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000042d82e46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3310:1873884700737664:0@lo:250: 00000100:00100000:0.0:1787075781.563166:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075781.563295:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700737664 00000100:00100000:0.0:1787075781.563307:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700737664 00000100:00100000:0.0:1787075781.563357:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787075781.563363:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5214473 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1873884700737664:12345-0@lo:250: 00010000:00080000:0.0:1787075781.568025:0:5844:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from f837e7e9-66a9-4dbd-86cd-a110c11486d7@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:0.0:1787075781.568066:0:5844:0:(genops.c:1406:class_connect()) connect: client f837e7e9-66a9-4dbd-86cd-a110c11486d7, cookie 0x859911ad6869f1df 00000100:00080000:0.0:1787075781.569940:0:5844:0:(import.c:65:import_set_state_nolock()) 00000000f1c3a9d6 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787075781.570056:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5214473 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+5:3310:x1873884700737664:12345-0@lo:250: Request processed in 6691us (6890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075781.570067:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787075781.570149:0:3310:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787075781.570157:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.150@tcp: connect to target with instance 0 00000100:00080000:0.0:1787075781.571817:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787075781.571829:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787075781.571834:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000d551216a MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787075781.571838:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787075781.571863:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787075781.571870:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000042d82e46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3310:1873884700737664:0@lo:250: 00000100:00100000:1.0:1787075781.586006:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787075781.586220:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787075781.586226:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787075781.591164:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787075781.591178:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787075781.591578:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787075781.591584:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787075781.593340:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787075781.593519:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787075781.593526:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787075781.594540:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787075781.594548:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787075781.635181:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787075781.635492:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787075781.635501:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787075781.639310:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787075781.639328:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787075781.640054:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787075781.640273:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787075781.640279:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787075781.641035:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787075781.641045:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787075781.641951:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787075781.642773:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787075781.642783:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787075781.644026:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787075781.644036:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787075781.644758:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787075781.644994:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787075781.645000:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787075781.645968:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787075781.645976:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787075781.686206:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787075781.686436:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787075781.686443:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787075781.688230:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787075781.688245:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787075781.689719:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787075781.689732:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787075781.690779:0:5832:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787075781.690808:0:5832:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787075781.690815:0:5832:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787075781.690950:0:5832:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787075781.690990:0:5832:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.150@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787075781.690994:0:5832:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787075781.690996:0:5832:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787075781.690997:0:5832:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787075781.690999:0:5832:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787075781.691000:0:5832:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787075781.691001:0:5832:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787075781.691002:0:5832:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787075781.691004:0:5832:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787075781.691006:0:5832:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787075781.691007:0:5832:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787075781.691012:0:5832:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787075781.691014:0:5832:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787075781.691016:0:5832:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787075781.691019:0:5832:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787075781.691020:0:5832:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787075781.691020:0:5832:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787075781.691021:0:5832:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787075781.691022:0:5832:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787075781.691023:0:5832:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787075781.691024:0:5832:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787075781.691024:0:5832:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787075781.691025:0:5832:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787075781.691026:0:5832:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787075781.691027:0:5832:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787075781.691027:0:5832:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787075781.691066:0:5832:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787075781.691082:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a28e4091 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700737792:0@lo:253: 00000100:00100000:2.0:1787075781.691329:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075781.691387:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dfc792b0 going to sleep for 11 seconds 00000100:00100000:3.0:1787075781.691444:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700737792 00000100:00100000:3.0:1787075781.691451:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700737792 00000100:00100000:3.0:1787075781.691488:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787075781.691494:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000550afe2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+5:5832:x1873884700737792:12345-0@lo:253: 20000000:01000000:3.0:1787075781.691530:0:5847:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787075781.691532:0:5847:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787075781.692092:0:5868:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787075781.692288:0:5847:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787075781.692636:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787075781.693711:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787075781.694092:0:5847:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787075781.694096:0:5847:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787075781.694102:0:5847:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787075781.694105:0:5847:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787075781.694122:0:5847:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787075781.694347:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787075781.696492:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787075781.696521:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787075781.696595:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787075781.696793:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787075781.696921:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787075781.697121:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787075781.697130:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787075781.697315:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787075781.697325:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787075781.697357:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787075781.697373:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787075781.697405:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787075781.697455:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787075781.697490:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787075781.697495:0:5847:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787075781.697507:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787075781.698347:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787075781.698364:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787075781.698407:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787075781.698437:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787075781.698476:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787075781.698488:0:5847:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787075781.698567:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787075781.698574:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787075781.699291:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787075781.699347:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787075781.699384:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787075781.699396:0:5847:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787075781.699494:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787075781.699503:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787075781.699534:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787075781.699567:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787075781.700428:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787075781.700486:0:5847:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787075781.700493:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787075781.704414:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787075781.704858:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787075781.704886:0:5847:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.150@tcp for mdt 20000000:01000000:3.0:1787075781.704889:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.150@tcp (null) (null) (null) 00000040:00080000:3.0:1787075781.704928:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787075781.704936:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787075781.704967:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787075781.704975:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.150@tcp (null) (null) 00000040:00080000:3.0:1787075781.705055:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787075781.705066:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787075781.705099:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787075781.705130:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787075781.705846:0:5847:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787075781.705851:0:5847:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787075781.705857:0:5847:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787075781.705863:0:5847:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787075781.707917:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1787075781.708077:0:5847:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787075781.730459:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787075781.730525:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1787075781.731273:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1787075781.731306:0:5847:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787075781.731309:0:5847:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787075781.731313:0:5847:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787075781.731330:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787075781.731333:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787075781.731373:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787075781.731376:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787075781.732491:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1787075781.733086:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1787075781.733150:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1787075781.733236:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1787075781.733250:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787075781.733253:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787075781.738573:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787075781.739065:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787075781.739117:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787075781.739169:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1787075781.739185:0:5847:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787075781.739188:0:5847:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1787075781.739196:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787075781.739217:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003bd712a5/0x859911ad6869f1e6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.739244:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003bd712a5/0x859911ad6869f1e6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.739255:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003bd712a5/0x859911ad6869f1e6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.739261:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003bd712a5/0x859911ad6869f1e6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.739268:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003bd712a5/0x859911ad6869f1e6 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.739274:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003bd712a5/0x859911ad6869f1e6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.739281:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003bd712a5 already unused, calling callback (000000002476ad05) 00010000:00010000:0.0:1787075781.739283:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003bd712a5/0x859911ad6869f1e6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.739310:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003bd712a5/0x859911ad6869f1e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.739325:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003bd712a5/0x859911ad6869f1e6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.739332:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003bd712a5/0x859911ad6869f1e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.739337:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003bd712a5/0x859911ad6869f1e6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787075781.739357:0:5847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787075781.985317:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000550afe2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+5:5832:x1873884700737792:12345-0@lo:253: Request processed in 293812us (293978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075781.985335:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787075781.985427:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a28e4091 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700737792:0@lo:253: 10000000:01000000:2.0:1787075781.985506:0:5832:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787075781.985511:0:5832:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787075781.985513:0:5832:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787075781.985514:0:5832:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787075781.985515:0:5832:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787075781.985516:0:5832:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787075781.985518:0:5832:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787075781.985519:0:5832:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787075781.985520:0:5832:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787075781.985522:0:5832:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787075781.985524:0:5832:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787075781.985525:0:5832:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787075781.985544:0:5832:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ede08f00 from lustre-MDT0000 10000000:01000000:2.0:1787075781.985572:0:5832:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787075781.985575:0:5832:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787075781.985579:0:5832:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9961b009b380 10000000:01000000:2.0:1787075781.985583:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787075781.985591:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9961b009b380 from 1 10000000:01000000:2.0:1787075781.985593:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787075781.985659:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 00000000b1dd847c/0x859911ad6869f1ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075781.985670:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 00000000b1dd847c/0x859911ad6869f1ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075781.985680:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 00000000b1dd847c/0x859911ad6869f1ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075781.985699:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a28e4091 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700737920:0@lo:101: 00000100:00100000:2.0:1787075781.985737:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075781.985923:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 000000000d5d4a8b going to sleep for 11 seconds 00000100:00100000:0.0:1787075781.986039:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700737920 00000100:00100000:0.0:1787075781.986047:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700737920 00000100:00100000:0.0:1787075781.986259:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787075781.986268:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000035f7c3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+5:5832:x1873884700737920:12345-0@lo:101: 00010000:00010000:0.0:1787075781.986280:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075781.986297:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003bd712a5/0x859911ad6869f1f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f1ed expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.986323:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003bd712a5/0x859911ad6869f1f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f1ed expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.986333:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003bd712a5/0x859911ad6869f1f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f1ed expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.986355:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003bd712a5, rc 0) 00000100:00100000:0.0:1787075781.986518:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000035f7c3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+6:5832:x1873884700737920:12345-0@lo:101: Request processed in 253us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075781.986526:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787075781.986608:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a28e4091 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700737920:0@lo:101: 00010000:00010000:3.0:1787075781.986632:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 00000000b1dd847c/0x859911ad6869f1ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f1f4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075781.986673:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 00000000b1dd847c/0x859911ad6869f1ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f1f4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075781.986744:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700738048:0@lo:501: 00000100:00100000:3.0:1787075781.986796:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075781.986818:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 0000000068d743fb going to sleep for 11 seconds 00000100:00100000:1.0:1787075781.986882:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700738048 00000100:00100000:1.0:1787075781.986887:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700738048 00000100:00100000:1.0:1787075781.986928:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787075781.986934:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005de86775 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+6:5832:x1873884700738048:12345-0@lo:501: 00000100:00100000:1.0:1787075781.987371:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005de86775 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+6:5832:x1873884700738048:12345-0@lo:501: Request processed in 436us (574us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787075781.987384:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787075781.987606:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700738048:0@lo:501: 10000000:01000000:3.0:1787075781.987665:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787075781.987677:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 00000000b1dd847c/0x859911ad6869f1ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f1f4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075781.987690:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 00000000b1dd847c/0x859911ad6869f1ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f1f4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787075781.987699:0:5832:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9961a03a5800 10000000:01000000:3.0:1787075781.987703:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787075781.987708:0:5832:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9961a03a5800 10000000:01000000:3.0:1787075781.987710:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787075781.987712:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9961a03a5800 from 1 10000000:01000000:3.0:1787075781.987715:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787075781.987741:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 0000000005a54249/0x859911ad6869f1fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075781.987747:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 0000000005a54249/0x859911ad6869f1fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075781.987816:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 0000000005a54249/0x859911ad6869f1fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075781.987830:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700738176:0@lo:101: 00000100:00100000:3.0:1787075781.987858:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075781.987975:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 0000000068d743fb going to sleep for 11 seconds 00000100:00100000:0.0:1787075781.988035:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700738176 00000100:00100000:0.0:1787075781.988040:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700738176 00000100:00100000:0.0:1787075781.988075:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787075781.988081:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c960344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+6:5832:x1873884700738176:12345-0@lo:101: 00010000:00010000:0.0:1787075781.988091:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075781.988100:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004e47d611/0x859911ad6869f202 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f1fb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.988116:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004e47d611/0x859911ad6869f202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f1fb expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.988285:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004e47d611/0x859911ad6869f202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f1fb expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.988296:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004e47d611, rc 0) 00000100:00100000:0.0:1787075781.988335:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c960344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+7:5832:x1873884700738176:12345-0@lo:101: Request processed in 254us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075781.988342:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787075781.988418:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700738176:0@lo:101: 00010000:00010000:3.0:1787075781.988429:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 0000000005a54249/0x859911ad6869f1fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f202 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075781.988437:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 0000000005a54249/0x859911ad6869f1fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f202 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787075781.988536:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787075781.988550:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 0000000005a54249/0x859911ad6869f1fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f202 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075781.988556:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 0000000005a54249/0x859911ad6869f1fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f202 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787075781.988562:0:5832:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787075781.988566:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787075781.988571:0:5832:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9961a03a5800 10000000:01000000:3.0:1787075781.988573:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787075781.988577:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787075781.988579:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787075781.988594:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 000000005215f2e9/0x859911ad6869f209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075781.988600:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 000000005215f2e9/0x859911ad6869f209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075781.988606:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 000000005215f2e9/0x859911ad6869f209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075781.988629:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700738304:0@lo:101: 00000100:00100000:3.0:1787075781.988687:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075781.988704:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 0000000068d743fb going to sleep for 11 seconds 00000100:00100000:0.0:1787075781.988867:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700738304 00000100:00100000:0.0:1787075781.988872:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700738304 00000100:00100000:0.0:1787075781.988906:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787075781.988913:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d841624 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+7:5832:x1873884700738304:12345-0@lo:101: 00010000:00010000:0.0:1787075781.988920:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075781.988934:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bda360d3/0x859911ad6869f210 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f209 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.988948:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bda360d3/0x859911ad6869f210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f209 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.988955:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bda360d3/0x859911ad6869f210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f209 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075781.988961:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bda360d3, rc 0) 00000100:00100000:0.0:1787075781.988997:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d841624 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+8:5832:x1873884700738304:12345-0@lo:101: Request processed in 85us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075781.989004:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787075781.989107:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700738304:0@lo:101: 00010000:00010000:3.0:1787075781.989116:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 000000005215f2e9/0x859911ad6869f209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f210 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075781.989211:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 000000005215f2e9/0x859911ad6869f209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f210 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075781.989255:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700738432:0@lo:501: 00000100:00100000:3.0:1787075781.989281:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075781.989303:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 0000000068d743fb going to sleep for 11 seconds 00000100:00100000:0.0:1787075781.989354:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700738432 00000100:00100000:0.0:1787075781.989358:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700738432 00000100:00100000:0.0:1787075781.989430:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787075781.989437:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c60e2530 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+8:5832:x1873884700738432:12345-0@lo:501: 00000100:00100000:1.0:1787075781.990033:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c60e2530 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+9:5832:x1873884700738432:12345-0@lo:501: Request processed in 595us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075781.990041:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787075781.990127:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700738432:0@lo:501: 00000100:00100000:3.0:1787075781.990229:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700738560:0@lo:503: 00000100:00100000:3.0:1787075781.990267:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075781.990331:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 0000000068d743fb going to sleep for 11 seconds 00000100:00100000:1.0:1787075781.990371:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700738560 00000100:00100000:1.0:1787075781.990376:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700738560 00000100:00100000:1.0:1787075781.990406:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787075781.990412:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e54cba9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+9:5832:x1873884700738560:12345-0@lo:503: 00000100:00100000:1.0:1787075781.990825:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e54cba9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+9:5832:x1873884700738560:12345-0@lo:503: Request processed in 344us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075781.990832:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787075781.990896:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700738560:0@lo:503: 00000100:00100000:0.0:1787075781.991434:0:5875:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005694ce1a pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5875:1873884700738688:0@lo:502: 00000100:00100000:0.0:1787075781.991544:0:5875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075781.991610:0:5875:0:(client.c:2702:ptlrpc_set_wait()) set 0000000088df1cd1 going to sleep for 11 seconds 00000100:00100000:1.0:1787075781.991714:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700738688 00000100:00100000:1.0:1787075781.991720:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700738688 00000100:00100000:1.0:1787075781.991834:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787075781.991841:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000deaccc4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+9:5875:x1873884700738688:12345-0@lo:502: 00000100:00100000:1.0:1787075781.993124:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000deaccc4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+9:5875:x1873884700738688:12345-0@lo:502: Request processed in 1278us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075781.993196:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787075781.993284:0:5875:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005694ce1a pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5875:1873884700738688:0@lo:502: 00000020:01000000:0.0:1787075781.993318:0:5875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787075781.993329:0:5875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787075781.993332:0:5875:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787075781.993336:0:5875:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787075781.993339:0:5875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787075781.993365:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000bfead64d) 00000020:00000080:0.0:1787075781.993383:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787075781.993390:0:5875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787075781.993556:0:5875:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787075781.993564:0:5875:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x859911ad6869f21e 00000020:00000080:1.0:1787075781.994044:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787075781.994050:0:5875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787075781.994054:0:5875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787075781.994056:0:5875:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787075781.994059:0:5875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787075781.994063:0:5875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787075781.994064:0:5875:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787075781.994067:0:5875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787075781.994083:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000004590d8ee) 00000020:00000080:1.0:1787075781.994096:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787075781.994105:0:5875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787075781.994106:0:5875:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787075781.994109:0:5875:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787075781.994115:0:5875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787075781.994268:0:5875:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ede08f00 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787075781.994280:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000e56030c4) 00000020:00000080:1.0:1787075781.994289:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787075781.994346:0:5875:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787075781.994352:0:5875:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x859911ad6869f233 00000020:00000080:1.0:1787075781.994526:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787075781.994532:0:5875:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787075781.994537:0:5875:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x859911ad6869f23a 00080000:01000000:1.0:1787075781.994542:0:5875:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787075781.994544:0:5875:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x859911ad6869f241 00080000:10000000:1.0:1787075781.995081:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787075781.995749:0:5875:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787075782.002856:0:5875:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787075782.121358:0:5875:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787075782.121839:0:5875:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787075782.125814:0:5875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787075782.126121:0:5875:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787075782.160469:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000082b9d053) 00000020:00000080:0.0:1787075782.160495:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787075782.160570:0:5875:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787075782.160577:0:5875:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x859911ad6869f24f 00000020:00000080:0.0:1787075782.161100:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1787075782.164426:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787075782.215074:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787075782.252884:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787075782.284336:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787075782.329323:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787075782.365775:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787075782.393958:0:5875:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x859911ad6869f256 00000020:00000080:0.0:1787075782.394657:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787075782.394669:0:5875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787075782.394675:0:5875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787075782.394677:0:5875:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787075782.394682:0:5875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787075782.394688:0:5875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787075782.394689:0:5875:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787075782.394692:0:5875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787075782.394730:0:5875:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787075782.394743:0:5875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787075782.394849:0:5875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787075782.394850:0:5875:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787075782.394854:0:5875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787075782.394857:0:5875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787075782.394858:0:5875:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787075782.394861:0:5875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787075782.394863:0:5875:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787075782.394906:0:5875:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005694ce1a pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5875:1873884700738816:0@lo:502: 00000100:00100000:0.0:1787075782.394986:0:5875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075782.395050:0:5875:0:(client.c:2702:ptlrpc_set_wait()) set 000000004218214d going to sleep for 11 seconds 00000100:00100000:1.0:1787075782.395148:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700738816 00000100:00100000:1.0:1787075782.395155:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700738816 00000100:00100000:1.0:1787075782.395196:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787075782.395204:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000979b192e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+9:5875:x1873884700738816:12345-0@lo:502: 00000100:00100000:1.0:1787075782.395513:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000979b192e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+9:5875:x1873884700738816:12345-0@lo:502: Request processed in 309us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075782.395521:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787075782.395757:0:5875:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005694ce1a pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5875:1873884700738816:0@lo:502: 00000020:01000000:0.0:1787075782.395797:0:5875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787075782.395802:0:5875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787075782.395804:0:5875:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787075782.395808:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787075782.396080:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787075782.396099:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787075782.396121:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 000000005215f2e9/0x859911ad6869f209 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f210 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075782.396134:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 000000005215f2e9/0x859911ad6869f209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f210 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787075782.396143:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9961a03a5800 from 1 10000000:01000000:2.0:1787075782.396146:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787075782.396173:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 00000000a8b730e0/0x859911ad6869f25d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075782.396181:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 00000000a8b730e0/0x859911ad6869f25d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075782.396190:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 00000000a8b730e0/0x859911ad6869f25d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075782.396204:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9143886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700738944:0@lo:101: 00000100:00100000:2.0:1787075782.396237:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075782.396271:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 0000000039d1c70b going to sleep for 11 seconds 00000100:00100000:0.0:1787075782.396323:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700738944 00000100:00100000:0.0:1787075782.396329:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700738944 00000100:00100000:0.0:1787075782.396373:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787075782.396380:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f478372 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+9:5832:x1873884700738944:12345-0@lo:101: 00010000:00010000:0.0:1787075782.396395:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075782.396407:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cfe9ea35/0x859911ad6869f264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f25d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075782.396435:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cfe9ea35/0x859911ad6869f264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f25d expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075782.396449:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cfe9ea35/0x859911ad6869f264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f25d expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075782.396459:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cfe9ea35, rc 0) 00000100:00100000:0.0:1787075782.396497:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f478372 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+10:5832:x1873884700738944:12345-0@lo:101: Request processed in 117us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075782.396502:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787075782.396587:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9143886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700738944:0@lo:101: 00010000:00010000:2.0:1787075782.396612:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 00000000a8b730e0/0x859911ad6869f25d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f264 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075782.396629:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 00000000a8b730e0/0x859911ad6869f25d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f264 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075782.397222:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9143886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700739072:0@lo:256: 00000100:00100000:2.0:1787075782.397259:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075782.397284:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 0000000039d1c70b going to sleep for 11 seconds 00000100:00100000:2.0:1787075782.397308:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700739072 00000100:00100000:2.0:1787075782.397312:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700739072 00000100:00100000:2.0:1787075782.397339:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787075782.397345:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000043e771b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+10:5832:x1873884700739072:12345-0@lo:256: 20000000:01000000:2.0:1787075782.397360:0:5846:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787075782.397365:0:5846:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787075782.397439:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000043e771b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+10:5832:x1873884700739072:12345-0@lo:256: Request processed in 94us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075782.397449:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787075782.397494:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9143886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700739072:0@lo:256: 10000000:01000000:2.0:1787075782.398580:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787075782.398691:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 00000000a8b730e0/0x859911ad6869f25d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f264 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075782.398702:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 00000000a8b730e0/0x859911ad6869f25d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f264 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787075782.398709:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9961a03a5800 from 1 10000000:01000000:2.0:1787075782.398712:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787075782.398741:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 0000000030d06a55/0x859911ad6869f26b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075782.398827:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 0000000030d06a55/0x859911ad6869f26b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075782.398850:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 0000000030d06a55/0x859911ad6869f26b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075782.398866:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9143886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700739200:0@lo:101: 00000100:00100000:2.0:1787075782.398918:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075782.398958:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 0000000039d1c70b going to sleep for 11 seconds 00000100:00100000:0.0:1787075782.399045:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700739200 00000100:00100000:0.0:1787075782.399056:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700739200 00000100:00100000:0.0:1787075782.399102:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787075782.399109:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2cac3bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+10:5832:x1873884700739200:12345-0@lo:101: 00010000:00010000:0.0:1787075782.399119:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075782.399133:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000089d38906/0x859911ad6869f272 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f26b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075782.399165:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000089d38906/0x859911ad6869f272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f26b expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075782.399173:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000089d38906/0x859911ad6869f272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f26b expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075782.399180:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000089d38906, rc 0) 00000100:00100000:0.0:1787075782.399212:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2cac3bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:5832:x1873884700739200:12345-0@lo:101: Request processed in 103us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075782.399218:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787075782.399486:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9143886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700739200:0@lo:101: 00010000:00010000:2.0:1787075782.399498:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 0000000030d06a55/0x859911ad6869f26b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f272 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075782.399505:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 0000000030d06a55/0x859911ad6869f26b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f272 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075782.399557:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9143886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700739328:0@lo:501: 00000100:00100000:2.0:1787075782.399581:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075782.399618:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 0000000039d1c70b going to sleep for 11 seconds 00000100:00100000:0.0:1787075782.399690:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700739328 00000100:00100000:0.0:1787075782.399695:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700739328 00000100:00100000:0.0:1787075782.399715:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787075782.399721:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000661f0beb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:5832:x1873884700739328:12345-0@lo:501: 00000100:00100000:0.0:1787075782.400347:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000661f0beb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:5832:x1873884700739328:12345-0@lo:501: Request processed in 624us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075782.400357:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787075782.400584:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9143886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700739328:0@lo:501: 00000100:00100000:3.0:1787075782.400681:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700739456:0@lo:503: 00000100:00100000:3.0:1787075782.400735:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075782.400869:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dc4a4231 going to sleep for 11 seconds 00000100:00100000:2.0:1787075782.401292:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700739456 00000100:00100000:2.0:1787075782.401300:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700739456 00000100:00100000:2.0:1787075782.401342:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787075782.401349:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f782ba54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:5832:x1873884700739456:12345-0@lo:503: 00000040:00080000:2.0:1787075782.401390:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787075782.401436:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f782ba54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:5832:x1873884700739456:12345-0@lo:503: Request processed in 88us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075782.401443:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787075782.401525:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700739456:0@lo:503: 00000040:00080000:3.0:1787075782.402890:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787075782.403063:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787075782.403087:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787075782.403109:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 0000000030d06a55/0x859911ad6869f26b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f272 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075782.403135:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 0000000030d06a55/0x859911ad6869f26b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f272 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787075782.403183:0:5832:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787075782.403186:0:5832:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9961a03a5800 10000000:01000000:2.0:1787075782.403188:0:5832:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9961a03a5800 10000000:01000000:2.0:1787075782.403192:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787075782.403197:0:5832:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9961a03a5800 from 1 10000000:01000000:2.0:1787075782.403200:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787075782.403231:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 0000000019752f80/0x859911ad6869f279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075782.403238:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 0000000019752f80/0x859911ad6869f279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075782.403247:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 0000000019752f80/0x859911ad6869f279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075782.403266:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009ae4f6e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700739584:0@lo:101: 00000100:00100000:2.0:1787075782.403326:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075782.403454:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 0000000039d1c70b going to sleep for 11 seconds 00000100:00100000:0.0:1787075782.403940:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700739584 00000100:00100000:0.0:1787075782.403949:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700739584 00000100:00100000:0.0:1787075782.404028:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787075782.404037:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049a25444 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:5832:x1873884700739584:12345-0@lo:101: 00010000:00010000:0.0:1787075782.404051:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075782.404064:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000052bdf2e2/0x859911ad6869f280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f279 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075782.404086:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000052bdf2e2/0x859911ad6869f280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f279 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075782.404109:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000052bdf2e2/0x859911ad6869f280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f279 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075782.404118:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000052bdf2e2, rc 0) 00000100:00100000:0.0:1787075782.404174:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049a25444 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5832:x1873884700739584:12345-0@lo:101: Request processed in 140us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075782.404182:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787075782.404263:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009ae4f6e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700739584:0@lo:101: 00010000:00010000:3.0:1787075782.404284:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 0000000019752f80/0x859911ad6869f279 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f280 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075782.404292:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 0000000019752f80/0x859911ad6869f279 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f280 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075782.404349:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700739712:0@lo:501: 00000100:00100000:3.0:1787075782.404377:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075782.405096:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 0000000002f721c8 going to sleep for 11 seconds 00000100:00100000:2.0:1787075782.405261:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700739712 00000100:00100000:2.0:1787075782.405272:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700739712 00000100:00100000:2.0:1787075782.405313:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787075782.405320:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e44f2bdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5832:x1873884700739712:12345-0@lo:501: 00000100:00100000:2.0:1787075782.405709:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e44f2bdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5832:x1873884700739712:12345-0@lo:501: Request processed in 389us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075782.405718:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787075782.406067:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700739712:0@lo:501: 00000100:00100000:3.0:1787075782.406115:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700739840:0@lo:503: 00000100:00100000:3.0:1787075782.406228:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075782.406262:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 0000000002f721c8 going to sleep for 11 seconds 00000100:00100000:2.0:1787075782.406318:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700739840 00000100:00100000:2.0:1787075782.406323:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700739840 00000100:00100000:2.0:1787075782.406348:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787075782.406354:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f6b61f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5832:x1873884700739840:12345-0@lo:503: 00000100:00100000:2.0:1787075782.406721:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f6b61f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5832:x1873884700739840:12345-0@lo:503: Request processed in 367us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075782.406729:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787075782.406973:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700739840:0@lo:503: 00000100:00100000:3.0:1787075782.407614:0:5880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5880:1873884700739968:0@lo:502: 00000100:00100000:2.0:1787075782.407976:0:5880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075782.408048:0:5880:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c43fe0ff going to sleep for 11 seconds 00000100:00100000:0.0:1787075782.408076:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700739968 00000100:00100000:0.0:1787075782.408083:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700739968 00000100:00100000:0.0:1787075782.408148:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787075782.408156:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0d44f33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5880:x1873884700739968:12345-0@lo:502: 00000100:00100000:0.0:1787075782.408428:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0d44f33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5880:x1873884700739968:12345-0@lo:502: Request processed in 272us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075782.408435:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787075782.408520:0:5880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5880:1873884700739968:0@lo:502: 00000020:01000004:3.0:1787075782.408577:0:5880:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787075782.408591:0:5880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d499bdba) 00000020:00000080:3.0:1787075782.408619:0:5880:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787075782.408996:0:5880:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ede08f00 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787075782.409001:0:5880:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ede08f00 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787075782.409004:0:5880:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ede08f00 4 00010000:00080000:3.0:1787075782.409032:0:5880:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000095ef4d7@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.150@tcp at head 00010000:00010000:3.0:1787075782.414342:0:5880:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787075782.414484:0:5880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787075782.414528:0:5880:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787075782.414549:0:5880:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x859911ad6869f28e 00000100:00080000:3.0:1787075782.414561:0:5880:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787075782.414567:0:5880:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000095ef4d7 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1787075782.414629:0:5880:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007bd11be9 x1873884700740096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787075782.416907:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873884700740096:0@lo:38: 00000100:00100000:0.0:1787075782.416988:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075782.417282:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700740096 00000100:00100000:3.0:1787075782.417294:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700740096 00000100:00100000:3.0:1787075782.417336:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787075782.417344:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005694ce1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1873884700740096:12345-0@lo:38: 00000100:00100000:3.0:1787075782.417409:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005694ce1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1873884700740096:12345-0@lo:38: Request processed in 65us (422us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787075782.417416:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787075782.417466:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787075782.417475:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000095ef4d7 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787075782.417488:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787075782.417491:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873884700740096:0@lo:38: 00000100:00080000:3.0:1787075782.420024:0:5880:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787075782.420475:0:5880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5880:1873884700740224:0@lo:502: 00000100:00100000:3.0:1787075782.420588:0:5880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075782.420665:0:5880:0:(client.c:2702:ptlrpc_set_wait()) set 00000000993e3e78 going to sleep for 11 seconds 00000100:00100000:0.0:1787075782.420888:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700740224 00000100:00100000:0.0:1787075782.420896:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700740224 00000100:00100000:0.0:1787075782.420957:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787075782.420966:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a21545a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5880:x1873884700740224:12345-0@lo:502: 00000100:00100000:0.0:1787075782.421251:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a21545a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5880:x1873884700740224:12345-0@lo:502: Request processed in 286us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075782.421260:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787075782.421371:0:5880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5880:1873884700740224:0@lo:502: 00000040:00080000:3.0:1787075782.421403:0:5880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787075782.421601:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787075782.421629:0:5832:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787075782.421679:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 0000000019752f80/0x859911ad6869f279 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f280 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075782.421701:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 0000000019752f80/0x859911ad6869f279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f280 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787075782.421931:0:5832:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787075782.421935:0:5832:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787075782.421936:0:5832:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787075782.421937:0:5832:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787075782.421938:0:5832:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787075782.421940:0:5832:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787075782.421941:0:5832:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787075782.421942:0:5832:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787075782.421944:0:5832:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787075782.421945:0:5832:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787075782.421947:0:5832:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787075782.421949:0:5832:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787075782.421953:0:5832:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787075782.421956:0:5832:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787075782.421957:0:5832:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787075782.421958:0:5832:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787075782.421959:0:5832:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787075782.421961:0:5832:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787075782.421962:0:5832:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787075782.421963:0:5832:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787075782.421964:0:5832:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787075782.421964:0:5832:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787075782.421966:0:5832:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787075782.421967:0:5832:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787075782.421968:0:5832:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787075782.422043:0:5832:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787075782.422057:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700740352:0@lo:253: 00000100:00100000:3.0:1787075782.422104:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075782.422137:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 00000000993e3e78 going to sleep for 11 seconds 00000100:00100000:0.0:1787075782.422181:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700740352 00000100:00100000:0.0:1787075782.422187:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700740352 00000100:00100000:0.0:1787075782.422227:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787075782.422235:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080c88b6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5832:x1873884700740352:12345-0@lo:253: 20000000:01000000:0.0:1787075782.422269:0:5847:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787075782.422282:0:5847:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787075782.459466:0:5847:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787075782.459504:0:5847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787075782.459564:0:5868:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787075782.459569:0:5868:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787075782.459596:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ba586150/0x859911ad6869f295 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075782.459628:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cfe9ea35/0x859911ad6869f264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f25d expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075782.459636:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ba586150/0x859911ad6869f295 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075782.459715:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cfe9ea35/0x859911ad6869f264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f25d expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075782.459733:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cfe9ea35/0x859911ad6869f264 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f25d expref: 12 pid: 5847 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075782.461198:0:5868:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000016cedd32 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1873884700740480:0@lo:104: 00000100:00100000:2.0:1787075782.461273:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075782.461327:0:5868:0:(client.c:2702:ptlrpc_set_wait()) set 0000000012b3273d going to sleep for 11 seconds 00000100:00100000:3.0:1787075782.461856:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700740480 00000100:00100000:3.0:1787075782.461868:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700740480 00000100:00100000:3.0:1787075782.461929:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787075782.461938:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d930c17f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:5868:x1873884700740480:12345-0@lo:104: 00010000:00010000:3.0:1787075782.461954:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: 00000000a8b730e0/0x859911ad6869f25d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f264 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075782.462019:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787075782.462025:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d930c17f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:5868:x1873884700740480:12345-0@lo:104: Request processed in 88us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075782.462032:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787075782.462069:0:5868:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000016cedd32 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1873884700740480:0@lo:104: 00010000:00010000:3.0:1787075782.462089:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ba586150/0x859911ad6869f295 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462274:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787075782.462280:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: 00000000a8b730e0/0x859911ad6869f25d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f264 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462287:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a8b730e0 already unused, calling callback (0000000091494b3f) 10000000:00010000:1.0:1787075782.462291:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: 00000000a8b730e0/0x859911ad6869f25d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f264 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462315:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: 00000000a8b730e0/0x859911ad6869f25d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f264 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787075782.462321:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: 00000000a8b730e0/0x859911ad6869f25d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f264 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075782.462326:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787075782.462383:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: 00000000a8b730e0/0x859911ad6869f25d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f264 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462392:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787075782.462412:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: 00000000a8b730e0/0x859911ad6869f25d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f264 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462418:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: 00000000a8b730e0/0x859911ad6869f25d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f264 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462435:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075782.462437:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075782.462438:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075782.462519:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004d558a9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700740608:0@lo:103: 00000100:00100000:1.0:1787075782.462555:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075782.462637:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700740608 00000100:00100000:1.0:1787075782.462676:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700740608 00010000:00010000:1.0:1787075782.462693:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cfe9ea35/0x859911ad6869f264 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f25d expref: 13 pid: 5847 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075782.462714:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787075782.462720:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000deb0f948 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:3312:x1873884700740608:12345-0@lo:103: 00010000:00010000:1.0:1787075782.462737:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075782.462741:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cfe9ea35/0x859911ad6869f264 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f25d expref: 13 pid: 5847 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462765:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cfe9ea35/0x859911ad6869f264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f25d expref: 13 pid: 5847 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462779:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cfe9ea35/0x859911ad6869f264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f25d expref: 13 pid: 5847 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462794:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ba586150/0x859911ad6869f295 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462800:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ba586150/0x859911ad6869f295 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787075782.462814:0:5836:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003245373s 00010000:00010000:1.0:1787075782.462817:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ba586150/0x859911ad6869f295 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462822:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ba586150/0x859911ad6869f295 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462828:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ba586150/0x859911ad6869f295 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462832:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ba586150/0x859911ad6869f295 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462837:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ba586150 already unused, calling callback (000000002476ad05) 00010000:00010000:1.0:1787075782.462840:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ba586150/0x859911ad6869f295 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462855:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ba586150/0x859911ad6869f295 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462867:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ba586150/0x859911ad6869f295 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462876:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075782.462904:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000deb0f948 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:3312:x1873884700740608:12345-0@lo:103: Request processed in 185us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075782.462911:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787075782.462954:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004d558a9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700740608:0@lo:103: 00010000:00010000:1.0:1787075782.462971:0:5868:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ba586150/0x859911ad6869f295 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462977:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ba586150/0x859911ad6869f295 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075782.462982:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ba586150/0x859911ad6869f295 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075782.471273:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080c88b6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:5832:x1873884700740352:12345-0@lo:253: Request processed in 49030us (49161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075782.471291:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787075782.471389:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007bd11be9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5832:1873884700740352:0@lo:253: 10000000:01000000:2.0:1787075782.471422:0:5832:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787075782.471426:0:5832:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787075782.471428:0:5832:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787075782.471429:0:5832:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787075782.471430:0:5832:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787075782.471431:0:5832:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787075782.471432:0:5832:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787075782.471433:0:5832:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787075782.471434:0:5832:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787075782.471436:0:5832:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787075782.471437:0:5832:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787075782.471438:0:5832:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787075782.471440:0:5832:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787075782.471457:0:5832:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787075782.481392:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787075782.482040:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787075782.482253:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787075782.482425:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787075782.482636:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787075782.483023:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787075782.483623:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787075782.484077:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787075782.484313:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787075782.484499:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787075782.485129:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787075782.485324:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1787075782.520118:0:5832:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:1.0:1787075782.542900:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787075782.552941:0:5832:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787075782.553098:0:5885:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787075782.553102:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787075782.553310:0:5886:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787075782.559926:0:5832:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787075782.560114:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787075782.564324:0:5832:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787075782.564343:0:5832:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787075782.565429:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787075782.568842:0:5832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787075782.569684:0:5832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787075782.569994:0:5832:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787075782.570387:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787075782.571003:0:5832:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1787075782.573375:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787075782.573560:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787075782.574307:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787075782.574464:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787075782.574725:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787075782.574957:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787075782.575095:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787075782.575848:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787075782.576055:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787075782.576192:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787075782.579893:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787075782.580092:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787075782.581589:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787075782.581858:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787075782.582021:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787075782.582157:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787075782.583007:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787075782.583164:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787075782.583476:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787075782.583924:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787075782.584119:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787075782.584351:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787075782.584513:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787075782.584942:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787075782.585120:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787075782.588164:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787075782.588448:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787075782.588617:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787075782.588837:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787075782.588974:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787075782.589116:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787075782.589256:0:5832:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787075782.589486:0:5832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787075782.613871:0:5886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787075782.669248:0:5886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787075782.669353:0:5886:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787075782.669359:0:5886:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1787075782.669893:0:5832:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787075782.669930:0:5832:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb0b1c1d87988 00100000:10000000:0.0:1787075782.669939:0:5832:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787075782.670970:0:5832:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787075782.670986:0:5832:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787075782.671002:0:5832:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787075782.671019:0:5832:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1787075783.563100:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075784.585810:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075785.611026:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075786.633140:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787075786.969587:0:6128:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1787075787.468264:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787075787.468275:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787075787.468278:0:8:0:(import.c:65:import_set_state_nolock()) 00000000095ef4d7 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787075787.468290:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000095ef4d7 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:1.0:1787075787.468323:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000208b11db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700740736:0@lo:400: 00000100:00100000:2.0:1787075787.468364:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e0fef770 x1873884700740864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787075787.468393:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075787.468395:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e0fef770 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873884700740864:0@lo:38: 00000100:00100000:2.0:1787075787.468445:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075787.468482:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700740736 00000100:00100000:2.0:1787075787.468490:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700740736 00000100:00100000:2.0:1787075787.468542:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787075787.468550:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fbe11c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:3313:x1873884700740736:12345-0@lo:400: 00000100:00100000:2.0:1787075787.468594:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fbe11c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:3313:x1873884700740736:12345-0@lo:400: Request processed in 45us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075787.468620:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787075787.468682:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000208b11db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700740736:0@lo:400: 00000100:00100000:1.0:1787075787.471257:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700740864 00000100:00100000:1.0:1787075787.471271:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700740864 00000100:00100000:1.0:1787075787.471330:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787075787.471336:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0aebdd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1873884700740864:12345-0@lo:38: 00010000:00080000:1.0:1787075787.471364:0:5854:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:1.0:1787075787.471411:0:5854:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x859911ad6869f29c 00000004:00100000:1.0:1787075787.471454:0:5854:0:(mdt_handler.c:7351:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787075787.471578:0:5854:0:(import.c:65:import_set_state_nolock()) 00000000e6a8e15a : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787075787.475089:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0aebdd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873884700740864:12345-0@lo:38: Request processed in 3743us (6635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075787.475116:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787075787.475937:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e0fef770 x1873884700740864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787075797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787075787.475956:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787075787.475964:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787075787.475969:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787075787.475972:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000095ef4d7 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787075787.475978:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e0fef770 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873884700740864:0@lo:38: 00010000:00010000:0.0:1787075787.668435:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075788.683250:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075789.703904:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787075790.024171:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787075790.024180:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9961a03a5800 from 3 10000000:01000000:1.0:1787075790.024184:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787075790.024229:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 000000005a727d98/0x859911ad6869f2a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075790.024243:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 000000005a727d98/0x859911ad6869f2a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075790.024256:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 000000005a727d98/0x859911ad6869f2a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075790.024278:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004d558a9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700740992:0@lo:101: 00000100:00100000:1.0:1787075790.024344:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075790.024393:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set 000000002c7d899c going to sleep for 11 seconds 00000100:00100000:3.0:1787075790.024439:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700740992 00000100:00100000:3.0:1787075790.024447:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700740992 00000100:00100000:3.0:1787075790.024506:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787075790.024514:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002383600a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:5849:x1873884700740992:12345-0@lo:101: 00010000:00010000:3.0:1787075790.024528:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075790.024541:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b31d0861/0x859911ad6869f2aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f2a3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075790.024562:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b31d0861/0x859911ad6869f2aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f2a3 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075790.024584:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b31d0861/0x859911ad6869f2aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f2a3 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075790.024592:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b31d0861, rc 0) 00000100:00100000:3.0:1787075790.024629:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002383600a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5849:x1873884700740992:12345-0@lo:101: Request processed in 116us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075790.024635:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787075790.024701:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004d558a9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700740992:0@lo:101: 00010000:00010000:3.0:1787075790.024714:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 000000005a727d98/0x859911ad6869f2a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f2aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075790.024721:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 000000005a727d98/0x859911ad6869f2a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f2aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075790.024768:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009a63efe9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700741120:0@lo:256: 00000100:00100000:3.0:1787075790.024796:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075790.024816:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ea92669f going to sleep for 11 seconds 00000100:00100000:3.0:1787075790.024828:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700741120 00000100:00100000:3.0:1787075790.024831:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700741120 00000100:00100000:3.0:1787075790.024852:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787075790.024858:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007127af21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5849:x1873884700741120:12345-0@lo:256: 20000000:01000000:3.0:1787075790.024872:0:5844:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787075790.024891:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787075790.024893:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787075790.024971:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007127af21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5849:x1873884700741120:12345-0@lo:256: Request processed in 113us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075790.024978:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787075790.025012:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009a63efe9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700741120:0@lo:256: 10000000:01000000:3.0:1787075790.025054:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787075790.025061:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 000000005a727d98/0x859911ad6869f2a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f2aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075790.025069:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 000000005a727d98/0x859911ad6869f2a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f2aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075790.735457:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075791.762782:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787075791.890359:0:6331:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc3e967660 20000000:00000080:0.0:1787075791.890431:0:6331:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9961baedcc00 uarg=0000000000000000 20000000:01000000:0.0:1787075791.890466:0:6331:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787075791.890474:0:6331:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787075791.890478:0:6331:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787075791.892262:0:6331:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787075791.892283:0:6331:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787075791.900313:0:6331:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787075791.900824:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787075791.900899:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787075791.900954:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787075791.900973:0:6331:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787075791.901466:0:6331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000e81f017/0x859911ad6869f2b1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075791.901490:0:6331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000089d38906/0x859911ad6869f272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f26b expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075791.901497:0:6331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000e81f017/0x859911ad6869f2b1 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075791.901550:0:6331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000089d38906/0x859911ad6869f272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f26b expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075791.901586:0:6331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000089d38906/0x859911ad6869f272 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f26b expref: 11 pid: 5846 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075791.901601:0:6331:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ef5986e7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6331:1873884700741248:0@lo:104: 00000100:00100000:1.0:1787075791.901702:0:6331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075791.901766:0:6331:0:(client.c:2702:ptlrpc_set_wait()) set 000000008f1c74ee going to sleep for 11 seconds 00000100:00100000:0.0:1787075791.901922:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700741248 00000100:00100000:0.0:1787075791.901930:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700741248 00000100:00100000:0.0:1787075791.901983:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787075791.902002:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002299b5e5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:6331:x1873884700741248:12345-0@lo:104: 00010000:00010000:0.0:1787075791.902016:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: 0000000030d06a55/0x859911ad6869f26b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f272 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075791.902079:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787075791.902085:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002299b5e5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:6331:x1873884700741248:12345-0@lo:104: Request processed in 85us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075791.902092:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787075791.902112:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787075791.902123:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: 0000000030d06a55/0x859911ad6869f26b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f272 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075791.902130:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000030d06a55 already unused, calling callback (0000000091494b3f) 10000000:00010000:0.0:1787075791.902133:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: 0000000030d06a55/0x859911ad6869f26b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f272 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075791.902141:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: 0000000030d06a55/0x859911ad6869f26b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f272 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787075791.902147:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: 0000000030d06a55/0x859911ad6869f26b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f272 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787075791.902153:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787075791.902178:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: 0000000030d06a55/0x859911ad6869f26b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f272 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075791.902185:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787075791.902203:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: 0000000030d06a55/0x859911ad6869f26b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f272 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075791.902209:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: 0000000030d06a55/0x859911ad6869f26b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f272 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075791.902228:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075791.902230:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075791.902231:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075791.902243:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000044b8eab0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700741376:0@lo:103: 00000100:00100000:2.0:1787075791.902272:0:6331:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ef5986e7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6331:1873884700741248:0@lo:104: 00010000:00010000:2.0:1787075791.902295:0:6331:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000e81f017/0x859911ad6869f2b1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075791.903885:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075791.904005:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700741376 00000100:00100000:1.0:1787075791.904014:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700741376 00010000:00010000:1.0:1787075791.904044:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000089d38906/0x859911ad6869f272 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f26b expref: 12 pid: 5846 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075791.904084:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787075791.904093:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000208b11db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:3314:x1873884700741376:12345-0@lo:103: 00010000:00010000:1.0:1787075791.904106:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075791.904111:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000089d38906/0x859911ad6869f272 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f26b expref: 12 pid: 5846 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075791.904121:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000089d38906/0x859911ad6869f272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f26b expref: 12 pid: 5846 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075791.904139:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000089d38906/0x859911ad6869f272 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f26b expref: 12 pid: 5846 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075791.904154:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000e81f017/0x859911ad6869f2b1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075791.904161:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000e81f017/0x859911ad6869f2b1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075791.904190:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000e81f017/0x859911ad6869f2b1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075791.904196:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000e81f017/0x859911ad6869f2b1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075791.904201:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000e81f017/0x859911ad6869f2b1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075791.904206:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000e81f017/0x859911ad6869f2b1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075791.904212:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000e81f017 already unused, calling callback (000000002476ad05) 00010000:00010000:1.0:1787075791.904215:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000e81f017/0x859911ad6869f2b1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075791.904222:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000e81f017/0x859911ad6869f2b1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075791.904242:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000e81f017/0x859911ad6869f2b1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075791.904252:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075791.904301:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000208b11db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:3314:x1873884700741376:12345-0@lo:103: Request processed in 209us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075791.904308:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787075791.904443:0:6331:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000e81f017/0x859911ad6869f2b1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075791.904451:0:6331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000e81f017/0x859911ad6869f2b1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075791.904456:0:6331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000e81f017/0x859911ad6869f2b1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075791.904865:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000044b8eab0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700741376:0@lo:103: 00000100:00100000:1.0:1787075792.583903:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009a63efe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700741504:0@lo:400: 00000100:00100000:1.0:1787075792.583979:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075792.584076:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700741504 00000100:00100000:2.0:1787075792.584086:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700741504 00000100:00100000:2.0:1787075792.584141:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787075792.584151:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a8de7b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:3311:x1873884700741504:12345-0@lo:400: 00000100:00100000:1.0:1787075792.586771:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000029375c64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700741632:0@lo:400: 00000100:00100000:1.0:1787075792.587118:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075792.587123:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009a63efe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700741504:0@lo:400: 00000100:00100000:2.0:1787075792.587241:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a8de7b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:3311:x1873884700741504:12345-0@lo:400: Request processed in 3090us (3260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075792.587253:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787075792.587368:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700741632 00000100:00100000:1.0:1787075792.587376:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700741632 00000100:00100000:1.0:1787075792.587465:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787075792.587473:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f8d789a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700741632:12345-0@lo:400: 00000100:00100000:1.0:1787075792.587536:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f8d789a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700741632:12345-0@lo:400: Request processed in 64us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075792.587542:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787075792.587588:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000029375c64 x1873884700741632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075792.587615:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000029375c64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700741632:0@lo:400: 00010000:00010000:1.0:1787075792.779533:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075793.801036:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075794.823976:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075795.850275:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075796.872039:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787075797.193913:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787075797.194045:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9961a03a5800 from 1 10000000:01000000:0.0:1787075797.194050:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787075797.194096:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 000000004fa41e05/0x859911ad6869f2b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075797.194109:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 000000004fa41e05/0x859911ad6869f2b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075797.194118:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 000000004fa41e05/0x859911ad6869f2b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075797.194144:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000054f5fd90 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700741760:0@lo:101: 00000100:00100000:0.0:1787075797.194213:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075797.194278:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set 00000000171bf4ac going to sleep for 11 seconds 00000100:00100000:3.0:1787075797.194912:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700741760 00000100:00100000:3.0:1787075797.195046:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700741760 00000100:00100000:3.0:1787075797.195102:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787075797.195111:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2278d14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:5849:x1873884700741760:12345-0@lo:101: 00010000:00010000:3.0:1787075797.195127:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075797.195144:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000062ef57d7/0x859911ad6869f2bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f2b8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075797.195169:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000062ef57d7/0x859911ad6869f2bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f2b8 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075797.195178:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000062ef57d7/0x859911ad6869f2bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f2b8 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075797.195188:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000062ef57d7, rc 0) 00000100:00100000:3.0:1787075797.195239:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2278d14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5849:x1873884700741760:12345-0@lo:101: Request processed in 129us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075797.195246:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787075797.195412:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000054f5fd90 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700741760:0@lo:101: 00010000:00010000:0.0:1787075797.195428:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 000000004fa41e05/0x859911ad6869f2b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f2bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075797.195437:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 000000004fa41e05/0x859911ad6869f2b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f2bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075797.196369:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005e858edb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700741888:0@lo:501: 00000100:00100000:1.0:1787075797.196421:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075797.196464:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set 000000003fde9f6f going to sleep for 11 seconds 00000100:00100000:3.0:1787075797.196553:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700741888 00000100:00100000:3.0:1787075797.196568:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700741888 00000100:00100000:3.0:1787075797.196613:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787075797.196620:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092d7d68f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5849:x1873884700741888:12345-0@lo:501: 00000100:00100000:3.0:1787075797.198374:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092d7d68f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5849:x1873884700741888:12345-0@lo:501: Request processed in 1750us (1948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075797.198388:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787075797.198546:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005e858edb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700741888:0@lo:501: 00000100:00100000:1.0:1787075797.198594:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005e858edb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700742016:0@lo:503: 00000100:00100000:1.0:1787075797.198662:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075797.198689:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set 000000003fde9f6f going to sleep for 11 seconds 00000100:00100000:0.0:1787075797.198763:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700742016 00000100:00100000:0.0:1787075797.198769:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700742016 00000100:00100000:0.0:1787075797.198816:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787075797.198824:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020568a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5849:x1873884700742016:12345-0@lo:503: 00000100:00100000:0.0:1787075797.199049:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020568a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5849:x1873884700742016:12345-0@lo:503: Request processed in 225us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075797.199056:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787075797.199302:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005e858edb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700742016:0@lo:503: 00000100:00100000:1.0:1787075797.199704:0:6667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005e858edb pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6667:1873884700742144:0@lo:502: 00000100:00100000:1.0:1787075797.199794:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075797.199834:0:6667:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ad109ab8 going to sleep for 11 seconds 00000100:00100000:0.0:1787075797.200364:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700742144 00000100:00100000:0.0:1787075797.200371:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700742144 00000100:00100000:0.0:1787075797.200414:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787075797.200421:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012f29e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:6667:x1873884700742144:12345-0@lo:502: 00000100:00100000:0.0:1787075797.200621:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012f29e54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:6667:x1873884700742144:12345-0@lo:502: Request processed in 200us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075797.200629:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787075797.200839:0:6667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005e858edb pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6667:1873884700742144:0@lo:502: 00000020:01000000:3.0:1787075797.200866:0:6667:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787075797.200876:0:6667:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787075797.200878:0:6667:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787075797.200887:0:6667:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9961a03a5800 00000020:00000080:3.0:1787075797.200889:0:6667:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787075797.201054:0:6667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6667:1873884700742272:0@lo:502: 00000100:00100000:3.0:1787075797.201094:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075797.201128:0:6667:0:(client.c:2702:ptlrpc_set_wait()) set ffff996185caacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787075797.201181:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700742272 00000100:00100000:1.0:1787075797.201186:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700742272 00000100:00100000:1.0:1787075797.201218:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787075797.201225:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:6667:x1873884700742272:12345-0@lo:502: 00000100:00100000:1.0:1787075797.201399:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:6667:x1873884700742272:12345-0@lo:502: Request processed in 174us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075797.201406:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787075797.201683:0:6667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6667:1873884700742272:0@lo:502: 00000020:01000000:3.0:1787075797.201704:0:6667:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787075797.201709:0:6667:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787075797.201710:0:6667:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787075797.201715:0:6667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787075797.201933:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787075797.201954:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787075797.201964:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181496c00/0x859911ad6869f2b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f2bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075797.201986:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181496c00/0x859911ad6869f2b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f2bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075797.704933:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787075797.704961:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873884700742400:0@lo:400: 00000100:00100000:1.0:1787075797.705032:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075797.705203:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700742400 00000100:00100000:3.0:1787075797.705211:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700742400 00000100:00100000:3.0:1787075797.705266:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787075797.705277:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873884700742400:12345-0@lo:400: 00000100:00100000:3.0:1787075797.705348:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873884700742400:12345-0@lo:400: Request processed in 73us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075797.705357:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787075797.705590:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9961b9de7100 x1873884700742400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075797.705604:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873884700742400:0@lo:400: 00010000:00010000:0.0:1787075797.897072:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787075798.221952:0:6700:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787075798.221956:0:6700:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787075798.222060:0:6700:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9961c14da000 00000020:01000004:1.0:1787075798.222076:0:6700:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787075798.222087:0:6700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787075798.222101:0:6700:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9961b9e13380) 00000020:00000080:1.0:1787075798.222115:0:6700:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787075798.239544:0:6700:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787075798.239944:0:6700:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787075798.274841:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787075798.295078:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787075798.295115:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787075798.295174:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787075798.295199:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787075798.295571:0:6700:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787075798.295582:0:6700:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787075798.295594:0:6700:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x859911ad6869f2cd 00000020:01000004:0.0:1787075798.295603:0:6700:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787075798.295626:0:6700:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.150@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787075798.295630:0:6700:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787075798.295637:0:6700:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787075798.295686:0:6700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787075798.295700:0:6700:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9961b9e019c0) 00000020:00000080:0.0:1787075798.295711:0:6700:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1787075798.296776:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787075798.296922:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787075798.296934:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787075798.305580:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787075798.305592:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787075798.308751:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787075798.308770:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787075798.315197:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787075798.315422:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787075798.315429:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787075798.323135:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787075798.323155:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787075798.359914:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787075798.360225:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787075798.360232:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787075798.364902:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787075798.364930:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787075798.371381:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787075798.371404:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787075798.381105:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787075798.382142:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787075798.382152:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787075798.393190:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787075798.393246:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787075798.498505:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787075798.498861:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787075798.498868:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787075798.500559:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787075798.500569:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787075798.501246:0:6700:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787075798.501271:0:6700:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787075798.501277:0:6700:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787075798.543368:0:6700:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787075798.543408:0:6700:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.150@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787075798.543412:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787075798.543414:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787075798.543415:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787075798.543416:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787075798.543418:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787075798.543419:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787075798.543420:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787075798.543422:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787075798.543423:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787075798.543425:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787075798.543427:0:6700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787075798.543431:0:6700:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787075798.543433:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787075798.543435:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787075798.543436:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787075798.543437:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787075798.543438:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787075798.543439:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787075798.543440:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787075798.543441:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787075798.543442:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787075798.543443:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787075798.543444:0:6700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787075798.543480:0:6700:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787075798.543499:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700742528:0@lo:253: 00000100:00100000:2.0:1787075798.543568:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075798.543663:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff996185fc1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787075798.544010:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700742528 00000100:00100000:1.0:1787075798.544019:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700742528 00000100:00100000:1.0:1787075798.544076:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787075798.544085:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:6700:x1873884700742528:12345-0@lo:253: 20000000:01000000:1.0:1787075798.544125:0:5847:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787075798.544129:0:5847:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787075798.544134:0:5847:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787075798.544138:0:5847:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787075798.546247:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787075798.546486:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787075798.546500:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787075798.546541:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787075798.546549:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787075798.546579:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787075798.546629:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787075798.547065:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787075798.547085:0:5847:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.150@tcp 20000000:01000000:0.0:1787075798.547087:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.150@tcp (null) (null) (null) 00000040:00080000:0.0:1787075798.547121:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787075798.547129:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787075798.547174:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787075798.547183:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.150@tcp (null) (null) 00000040:00080000:0.0:1787075798.547214:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787075798.547223:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787075798.547253:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787075798.547314:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1787075798.548023:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787075798.548040:0:5847:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.150@tcp 20000000:01000000:0.0:1787075798.548042:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.150@tcp (null) (null) (null) 00000040:00080000:0.0:1787075798.548077:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787075798.548085:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787075798.548129:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787075798.548149:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.150@tcp (null) (null) 00000040:00080000:0.0:1787075798.548195:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787075798.548205:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787075798.548235:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1787075798.548268:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1787075798.548283:0:5847:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1787075798.548298:0:5847:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1787075798.548305:0:5847:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787075798.548307:0:5847:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787075798.548309:0:5847:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787075798.548323:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787075798.548326:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787075798.548356:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787075798.548359:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787075798.549463:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787075798.549788:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787075798.549834:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787075798.549899:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1787075798.549914:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787075798.549917:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787075798.550772:0:6717:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787075798.550834:0:6717:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787075798.550886:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787075798.551165:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787075798.551204:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787075798.551260:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787075798.551273:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787075798.551294:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787075798.551859:0:6718:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1787075798.551909:0:6718:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1787075798.551960:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787075798.552190:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787075798.552229:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787075798.552264:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:1.0:1787075798.552355:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787075798.552375:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996190039c00/0x859911ad6869f2db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.552395:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996180030600/0x859911ad6869f1f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f1ed expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.552402:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996180031000/0x859911ad6869f210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f209 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.552409:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996180030000/0x859911ad6869f280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f279 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.552421:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996190039c00/0x859911ad6869f2db lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.552457:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996180030000/0x859911ad6869f280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f279 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.552473:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996180030000/0x859911ad6869f280 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f279 expref: 12 pid: 5846 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075798.552487:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1873884700742656:0@lo:104: 00000100:00100000:1.0:1787075798.552553:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787075798.552815:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996180031000/0x859911ad6869f210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f209 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.552825:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996180031000/0x859911ad6869f210 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f209 expref: 12 pid: 5847 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075798.552834:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1873884700742784:0@lo:104: 00000100:00100000:1.0:1787075798.552858:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787075798.553545:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996180030600/0x859911ad6869f1f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f1ed expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.553559:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996180030600/0x859911ad6869f1f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f1ed expref: 12 pid: 5846 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075798.553570:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f57100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1873884700742912:0@lo:104: 00000100:00100000:1.0:1787075798.553601:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075798.554402:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700742656 00000100:00100000:2.0:1787075798.554432:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700742656 00000100:00100000:1.0:1787075798.554560:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618954dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787075798.554613:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700742784 00000100:00100000:0.0:1787075798.554618:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700742784 00000100:00100000:0.0:1787075798.554708:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700742912 00000100:00100000:0.0:1787075798.554712:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700742912 00000100:00100000:0.0:1787075798.554730:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787075798.554740:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+5:5847:x1873884700742784:12345-0@lo:104: 00010000:00010000:0.0:1787075798.554756:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f210 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075798.554830:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787075798.554836:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+5:5847:x1873884700742784:12345-0@lo:104: Request processed in 99us (1978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075798.554843:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787075798.554860:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787075798.554865:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+4:5847:x1873884700742912:12345-0@lo:104: 00010000:00010000:0.0:1787075798.554872:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f1ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f1f4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075798.554914:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787075798.554919:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+4:5847:x1873884700742912:12345-0@lo:104: Request processed in 54us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075798.554925:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787075798.554954:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787075798.554960:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:5847:x1873884700742656:12345-0@lo:104: 00010000:00010000:0.0:1787075798.554966:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f280 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075798.554993:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787075798.554998:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:5847:x1873884700742656:12345-0@lo:104: Request processed in 39us (2446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075798.555003:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787075798.555086:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787075798.555092:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f210 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555100:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996183be6000 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:3.0:1787075798.555105:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f210 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555113:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f210 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787075798.555120:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f210 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787075798.555126:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787075798.555158:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f210 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555171:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787075798.555190:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f209 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f210 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555198:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f209 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f210 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555212:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787075798.555215:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f1ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f1f4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555220:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522200 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:3.0:1787075798.555223:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f1ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f1f4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555229:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f1ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f1f4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787075798.555235:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f1ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f1f4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787075798.555240:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787075798.555253:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f1ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f1f4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555258:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787075798.555272:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f1ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f1f4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555299:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f1ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f1f4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555315:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787075798.555318:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f280 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555323:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523800 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:3.0:1787075798.555325:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f280 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555331:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f280 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787075798.555337:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f280 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787075798.555342:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787075798.555355:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f279 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f280 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555362:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787075798.555367:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f279 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f280 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555373:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f279 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f280 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555389:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787075798.555390:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787075798.555392:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787075798.555405:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700743040:0@lo:103: 00000100:00100000:3.0:1787075798.555448:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075798.555492:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700743168:0@lo:103: 00000100:00100000:3.0:1787075798.555513:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075798.555531:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787075798.555537:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700743296:0@lo:103: 00000100:00100000:3.0:1787075798.555554:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075798.555583:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700743040 00000100:00100000:3.0:1787075798.555587:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700743040 00010000:00010000:3.0:1787075798.555605:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996180031000/0x859911ad6869f210 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f209 expref: 13 pid: 5847 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075798.555619:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700743168 00000100:00100000:3.0:1787075798.555621:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700743168 00010000:00010000:3.0:1787075798.555629:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996180030600/0x859911ad6869f1f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f1ed expref: 14 pid: 5846 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075798.555664:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700743296 00000100:00100000:3.0:1787075798.555667:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700743296 00010000:00010000:3.0:1787075798.555678:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996180030000/0x859911ad6869f280 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f279 expref: 15 pid: 5846 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075798.555691:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787075798.555697:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:3314:x1873884700743040:12345-0@lo:103: 00010000:00010000:3.0:1787075798.555706:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075798.555711:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996180031000/0x859911ad6869f210 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f209 expref: 15 pid: 5847 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555719:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996180031000/0x859911ad6869f210 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f209 expref: 15 pid: 5847 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555745:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075798.555776:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:3314:x1873884700743040:12345-0@lo:103: Request processed in 79us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075798.555783:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787075798.555796:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787075798.555803:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:3311:x1873884700743168:12345-0@lo:103: 00010000:00010000:3.0:1787075798.555809:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075798.555813:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996180030600/0x859911ad6869f1f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f1ed expref: 14 pid: 5846 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555820:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996180030600/0x859911ad6869f1f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f1ed expref: 14 pid: 5846 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555831:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075798.555856:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:3311:x1873884700743168:12345-0@lo:103: Request processed in 54us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075798.555862:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787075798.555872:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787075798.555879:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:3311:x1873884700743296:12345-0@lo:103: 00010000:00010000:3.0:1787075798.555887:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075798.555891:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996180030000/0x859911ad6869f280 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f279 expref: 13 pid: 5846 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555900:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996180030000/0x859911ad6869f280 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f279 expref: 13 pid: 5846 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555910:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996190039c00/0x859911ad6869f2db lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555926:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996190039c00/0x859911ad6869f2db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555941:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996190039c00/0x859911ad6869f2db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555948:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996190039c00/0x859911ad6869f2db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555954:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996190039c00/0x859911ad6869f2db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555960:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996190039c00/0x859911ad6869f2db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555966:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190039c00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787075798.555969:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996190039c00/0x859911ad6869f2db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555977:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996190039c00/0x859911ad6869f2db lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555987:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996190039c00/0x859911ad6869f2db lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.555996:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075798.556019:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:3311:x1873884700743296:12345-0@lo:103: Request processed in 141us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075798.556026:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787075798.556068:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700743040:0@lo:103: 00000100:00100000:3.0:1787075798.556098:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700743296:0@lo:103: 00000100:00100000:3.0:1787075798.556105:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700743168:0@lo:103: 00010000:00010000:2.0:1787075798.556245:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075798.556327:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996180030000/0x859911ad6869f280 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f279 expref: 12 pid: 5846 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075798.556348:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1873884700742656:0@lo:104: 00010000:00010000:1.0:1787075798.556360:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996180031000/0x859911ad6869f210 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f209 expref: 11 pid: 5847 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075798.556368:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1873884700742784:0@lo:104: 00010000:00010000:1.0:1787075798.556376:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996180030600/0x859911ad6869f1f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f1ed expref: 10 pid: 5846 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075798.556383:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f57100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1873884700742912:0@lo:104: 00010000:00010000:1.0:1787075798.556401:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996190039c00/0x859911ad6869f2db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.556409:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996190039c00/0x859911ad6869f2db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.556415:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996190039c00/0x859911ad6869f2db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.556421:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996190039c00/0x859911ad6869f2db lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787075798.556437:0:5847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787075798.659776:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+9:6700:x1873884700742528:12345-0@lo:253: Request processed in 115681us (116196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075798.659791:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787075798.660724:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700742528:0@lo:253: 10000000:01000000:2.0:1787075798.660746:0:6700:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787075798.660750:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787075798.660752:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787075798.660755:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787075798.660756:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787075798.660758:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787075798.660759:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787075798.660761:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787075798.660763:0:6700:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787075798.660765:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787075798.660767:0:6700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787075798.660794:0:6700:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9961c14da000 from lustre-OST0000 10000000:01000000:2.0:1787075798.660819:0:6700:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787075798.660823:0:6700:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787075798.660830:0:6700:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9961b009b380 local copy 10000000:01000000:2.0:1787075798.660834:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787075798.660869:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181523400/0x859911ad6869f2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.660881:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.150@tcp lock: ffff996181523400/0x859911ad6869f2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.660889:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181523400/0x859911ad6869f2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075798.660908:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700743424:0@lo:101: 00000100:00100000:2.0:1787075798.660958:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075798.661026:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff996185fc1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787075798.661030:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700743424 00000100:00100000:0.0:1787075798.661037:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700743424 00000100:00100000:0.0:1787075798.661091:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787075798.661101:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+9:6700:x1873884700743424:12345-0@lo:101: 00010000:00010000:0.0:1787075798.661117:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075798.661133:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181497c00/0x859911ad6869f2e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f2e2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075798.661158:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181497c00/0x859911ad6869f2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f2e2 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075798.661192:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181497c00/0x859911ad6869f2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f2e2 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075798.661216:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181497c00, rc 0) 00000100:00100000:0.0:1787075798.661260:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+10:6700:x1873884700743424:12345-0@lo:101: Request processed in 160us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075798.661267:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787075798.661413:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700743424:0@lo:101: 00010000:00010000:1.0:1787075798.661439:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181523400/0x859911ad6869f2e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x859911ad6869f2e9 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.661448:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181523400/0x859911ad6869f2e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x859911ad6869f2e9 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075798.661567:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700743552:0@lo:501: 00000100:00100000:1.0:1787075798.661595:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075798.661617:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bbabcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787075798.661772:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700743552 00000100:00100000:2.0:1787075798.661777:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700743552 00000100:00100000:2.0:1787075798.661820:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787075798.661827:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+10:6700:x1873884700743552:12345-0@lo:501: 00000100:00100000:2.0:1787075798.662073:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+10:6700:x1873884700743552:12345-0@lo:501: Request processed in 246us (477us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787075798.662081:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787075798.662105:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700743552:0@lo:501: 10000000:01000000:1.0:1787075798.662118:0:6700:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787075798.662154:0:6700:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787075798.662159:0:6700:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181523400/0x859911ad6869f2e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x859911ad6869f2e9 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.662168:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181523400/0x859911ad6869f2e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x859911ad6869f2e9 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.662175:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff996181523400/0x859911ad6869f2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x859911ad6869f2e9 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.662199:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787075798.662217:0:6700:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9961c14da000 10000000:01000000:1.0:1787075798.662222:0:6700:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787075798.662227:0:6700:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9961b009b380 10000000:01000000:1.0:1787075798.662229:0:6700:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787075798.662233:0:6700:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9961b009b380 from 1 10000000:01000000:1.0:1787075798.662235:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787075798.662257:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190039c00/0x859911ad6869f2f0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.662265:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996190039c00/0x859911ad6869f2f0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.662283:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996190039c00/0x859911ad6869f2f0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075798.662309:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700743680:0@lo:101: 00000100:00100000:1.0:1787075798.662335:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075798.662362:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bbabcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787075798.662373:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700743680 00000100:00100000:2.0:1787075798.662377:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700743680 00010000:00010000:0.0:1787075798.662457:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787075798.662464:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181523400/0x859911ad6869f2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x859911ad6869f2e9 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075798.662473:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523400 already unused, calling callback (ffffffffc1bacc20) 00000100:00100000:2.0:1787075798.662476:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 10000000:00010000:0.0:1787075798.662477:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181523400/0x859911ad6869f2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x859911ad6869f2e9 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075798.662482:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+10:6700:x1873884700743680:12345-0@lo:101: 00010000:00010000:0.0:1787075798.662485:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181523400/0x859911ad6869f2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x859911ad6869f2e9 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.662491:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 10000000:00010000:0.0:1787075798.662493:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181523400/0x859911ad6869f2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x859911ad6869f2e9 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787075798.662500:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787075798.662501:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181523e00/0x859911ad6869f2f7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f2f0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.662517:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181523e00/0x859911ad6869f2f7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f2f0 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075798.662519:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181523400/0x859911ad6869f2e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x859911ad6869f2e9 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.662526:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181523e00/0x859911ad6869f2f7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f2f0 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075798.662526:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787075798.662533:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523e00, rc 0) 00010000:00010000:0.0:1787075798.662553:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181523400/0x859911ad6869f2e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x859911ad6869f2e9 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075798.662559:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:6700:x1873884700743680:12345-0@lo:101: Request processed in 77us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075798.662565:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1787075798.662571:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181523400/0x859911ad6869f2e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x859911ad6869f2e9 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075798.662586:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075798.662588:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075798.662589:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075798.662597:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787075798.662608:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700743808:0@lo:103: 00000100:00100000:0.0:1787075798.662685:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075798.662722:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700743808 00000100:00100000:0.0:1787075798.662726:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700743808 00000100:00100000:0.0:1787075798.662761:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787075798.662779:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:3314:x1873884700743808:12345-0@lo:103: 00010000:00010000:0.0:1787075798.662788:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075798.662801:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181497c00/0x859911ad6869f2e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x859911ad6869f2e2 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075798.662813:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075798.662838:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+10:3314:x1873884700743808:12345-0@lo:103: Request processed in 61us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075798.662844:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787075798.662852:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700743808:0@lo:103: 00000100:00100000:1.0:1787075798.663190:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700743680:0@lo:101: 00010000:00010000:1.0:1787075798.663205:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996190039c00/0x859911ad6869f2f0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f2f7 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.663213:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996190039c00/0x859911ad6869f2f0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f2f7 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075798.663230:0:6700:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787075798.663245:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190039c00/0x859911ad6869f2f0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f2f7 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.663253:0:6700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996190039c00/0x859911ad6869f2f0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f2f7 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075798.663261:0:6700:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787075798.663265:0:6700:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787075798.663270:0:6700:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787075798.663273:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787075798.663296:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190039600/0x859911ad6869f2fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.663303:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996190039600/0x859911ad6869f2fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.663319:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996190039600/0x859911ad6869f2fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075798.663332:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700743936:0@lo:101: 00000100:00100000:1.0:1787075798.663358:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075798.664046:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bbabcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787075798.664092:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700743936 00000100:00100000:2.0:1787075798.664098:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700743936 00000100:00100000:2.0:1787075798.664234:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787075798.664243:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+10:6700:x1873884700743936:12345-0@lo:101: 00010000:00010000:2.0:1787075798.664255:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075798.664278:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181523c00/0x859911ad6869f305 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f2fe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.664307:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181523c00/0x859911ad6869f305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f2fe expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.664317:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181523c00/0x859911ad6869f305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f2fe expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.664324:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523c00, rc 0) 00000100:00100000:2.0:1787075798.664390:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:6700:x1873884700743936:12345-0@lo:101: Request processed in 140us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075798.664397:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787075798.664489:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700743936:0@lo:101: 00010000:00010000:3.0:1787075798.664503:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996190039600/0x859911ad6869f2fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f305 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.664511:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996190039600/0x859911ad6869f2fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f305 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075798.664619:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700744064:0@lo:501: 00000100:00100000:3.0:1787075798.664689:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075798.665950:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff996183ee1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787075798.666064:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700744064 00000100:00100000:1.0:1787075798.666073:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700744064 00000100:00100000:1.0:1787075798.666306:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787075798.666315:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:6700:x1873884700744064:12345-0@lo:501: 00000100:00100000:1.0:1787075798.666633:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:6700:x1873884700744064:12345-0@lo:501: Request processed in 318us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075798.666657:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787075798.666874:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700744064:0@lo:501: 00000100:00100000:3.0:1787075798.666933:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700744192:0@lo:503: 00000100:00100000:3.0:1787075798.666978:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075798.667009:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff996183ee1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787075798.667066:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700744192 00000100:00100000:1.0:1787075798.667071:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700744192 00000100:00100000:1.0:1787075798.667092:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787075798.667099:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:6700:x1873884700744192:12345-0@lo:503: 00000100:00100000:1.0:1787075798.667318:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:6700:x1873884700744192:12345-0@lo:503: Request processed in 218us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075798.667325:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787075798.668007:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700744192:0@lo:503: 00000040:00080000:3.0:1787075798.668552:0:6700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787075798.668665:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700744320:0@lo:502: 00000100:00100000:3.0:1787075798.668722:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075798.668759:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff996183ee1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787075798.668908:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700744320 00000100:00100000:1.0:1787075798.668915:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700744320 00000100:00100000:1.0:1787075798.668945:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787075798.668953:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:6700:x1873884700744320:12345-0@lo:502: 00000100:00100000:1.0:1787075798.669341:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:6700:x1873884700744320:12345-0@lo:502: Request processed in 388us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075798.669361:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787075798.669592:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700744320:0@lo:502: 00000040:00080000:3.0:1787075798.670129:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787075798.670195:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787075798.670232:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787075798.670279:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787075798.670329:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787075798.670364:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787075798.670396:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700744448:0@lo:502: 00000100:00100000:3.0:1787075798.670557:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075798.670588:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff996183ee1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787075798.670696:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700744448 00000100:00100000:0.0:1787075798.670702:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700744448 00000100:00100000:0.0:1787075798.670733:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787075798.670741:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:6700:x1873884700744448:12345-0@lo:502: 00000100:00100000:0.0:1787075798.670909:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:6700:x1873884700744448:12345-0@lo:502: Request processed in 168us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075798.670928:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787075798.671199:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700744448:0@lo:502: 00000040:00080000:3.0:1787075798.671305:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787075798.671317:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787075798.671986:0:6719:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787075798.671994:0:6719:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787075798.672000:0:6719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787075798.672002:0:6719:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787075798.672007:0:6719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787075798.672022:0:6719:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9961b9e119c0) 00000020:00000080:1.0:1787075798.672041:0:6719:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787075798.672045:0:6719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787075798.673659:0:6719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9961c14da000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787075798.673673:0:6719:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787075798.673683:0:6719:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x859911ad6869f313 00010000:00010000:0.0:1787075798.681139:0:6719:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1787075798.682134:0:6719:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787075798.687779:0:6719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787075798.688104:0:6719:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787075798.697995:0:6719:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787075798.699128:0:6719:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787075798.700846:0:6719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787075798.700860:0:6719:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787075798.700866:0:6719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787075798.700869:0:6719:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787075798.700872:0:6719:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787075798.700876:0:6719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787075798.700877:0:6719:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787075798.700880:0:6719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787075798.700882:0:6719:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787075798.700939:0:6719:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787075798.700943:0:6719:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787075798.700944:0:6719:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787075798.700947:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787075798.701094:0:6700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787075798.701121:0:6700:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787075798.701143:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190039600/0x859911ad6869f2fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f305 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.701156:0:6700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996190039600/0x859911ad6869f2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f305 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075798.701164:0:6700:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9961c14da000 from 1 10000000:01000000:1.0:1787075798.701167:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787075798.701211:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190038400/0x859911ad6869f31a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.701220:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996190038400/0x859911ad6869f31a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.701231:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996190038400/0x859911ad6869f31a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075798.701265:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700744576:0@lo:101: 00000100:00100000:1.0:1787075798.701339:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075798.701398:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bbabc000 going to sleep for 11 seconds 00000100:00100000:2.0:1787075798.701581:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700744576 00000100:00100000:2.0:1787075798.701589:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700744576 00000100:00100000:2.0:1787075798.701661:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787075798.701673:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:6700:x1873884700744576:12345-0@lo:101: 00010000:00010000:2.0:1787075798.701688:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075798.701701:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181523a00/0x859911ad6869f321 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f31a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.701723:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181523a00/0x859911ad6869f321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f31a expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.701733:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181523a00/0x859911ad6869f321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f31a expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.701742:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523a00, rc 0) 00000100:00100000:2.0:1787075798.701784:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:6700:x1873884700744576:12345-0@lo:101: Request processed in 115us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075798.701800:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787075798.702011:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700744576:0@lo:101: 00010000:00010000:1.0:1787075798.702026:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996190038400/0x859911ad6869f31a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f321 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.702036:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996190038400/0x859911ad6869f31a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f321 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075798.702123:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700744704:0@lo:501: 00000100:00100000:1.0:1787075798.702148:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075798.702175:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bbabc000 going to sleep for 11 seconds 00000100:00100000:1.0:1787075798.702190:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700744704 00000100:00100000:1.0:1787075798.702194:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700744704 00000100:00100000:1.0:1787075798.702349:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787075798.702357:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:6700:x1873884700744704:12345-0@lo:501: 00000100:00100000:1.0:1787075798.703659:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:6700:x1873884700744704:12345-0@lo:501: Request processed in 1279us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075798.703674:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787075798.703938:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700744704:0@lo:501: 00000100:00100000:0.0:1787075798.703990:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700744832:0@lo:503: 00000100:00100000:0.0:1787075798.704046:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075798.704070:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191997f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787075798.704127:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700744832 00000100:00100000:1.0:1787075798.704134:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700744832 00000100:00100000:1.0:1787075798.704221:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787075798.704231:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191063850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:6700:x1873884700744832:12345-0@lo:503: 00000100:00100000:1.0:1787075798.704436:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191063850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:6700:x1873884700744832:12345-0@lo:503: Request processed in 197us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075798.704452:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787075798.706702:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700744832:0@lo:503: 00000040:00080000:0.0:1787075798.707064:0:6700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787075798.707139:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700744960:0@lo:502: 00000100:00100000:0.0:1787075798.707223:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075798.710334:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700744960 00000100:00100000:2.0:1787075798.710351:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700744960 00000100:00100000:2.0:1787075798.710418:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787075798.710437:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:6700:x1873884700744960:12345-0@lo:502: 00000100:00100000:0.0:1787075798.710742:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf05f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787075798.713373:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:6700:x1873884700744960:12345-0@lo:502: Request processed in 2937us (6140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075798.713970:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700744960:0@lo:502: 00000100:00100000:2.0:1787075798.714316:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000040:00080000:2.0:1787075798.718154:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787075798.718348:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787075798.718420:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700745088:0@lo:502: 00000100:00100000:2.0:1787075798.718631:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075798.718829:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff996185fc1180 going to sleep for 11 seconds 00000100:00100000:1.0:1787075798.719159:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700745088 00000100:00100000:1.0:1787075798.719168:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700745088 00000100:00100000:1.0:1787075798.719342:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787075798.719352:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:6700:x1873884700745088:12345-0@lo:502: 00000100:00100000:1.0:1787075798.719589:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:6700:x1873884700745088:12345-0@lo:502: Request processed in 238us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075798.719596:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787075798.719932:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700745088:0@lo:502: 00000040:00080000:3.0:1787075798.720086:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787075798.720106:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787075798.720996:0:6723:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787075798.721007:0:6723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787075798.721010:0:6723:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787075798.721017:0:6723:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9961c14da000 00000020:00000080:3.0:1787075798.721019:0:6723:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787075798.721038:0:6723:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787075798.721041:0:6723:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787075798.721042:0:6723:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787075798.721045:0:6723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787075798.721162:0:6700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787075798.721187:0:6700:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787075798.721220:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190038400/0x859911ad6869f31a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f321 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075798.721231:0:6700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996190038400/0x859911ad6869f31a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f321 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787075798.721280:0:6700:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787075798.721292:0:6700:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9961c14da000 10000000:01000000:0.0:1787075798.721295:0:6700:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9961c14da000 10000000:01000000:0.0:1787075798.721300:0:6700:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787075798.721308:0:6700:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9961c14da000 from 1 10000000:01000000:0.0:1787075798.721312:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787075798.721363:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181497c00/0x859911ad6869f328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075798.721371:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996181497c00/0x859911ad6869f328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075798.721545:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181497c00/0x859911ad6869f328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075798.721573:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700745216:0@lo:101: 00000100:00100000:0.0:1787075798.721683:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075798.721947:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf05fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787075798.722001:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700745216 00000100:00100000:2.0:1787075798.722009:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700745216 00000100:00100000:2.0:1787075798.722044:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787075798.722052:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:6700:x1873884700745216:12345-0@lo:101: 00010000:00010000:2.0:1787075798.722064:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075798.722077:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181522a00/0x859911ad6869f32f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f328 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.722100:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181522a00/0x859911ad6869f32f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f328 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.722110:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181522a00/0x859911ad6869f32f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f328 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.722120:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522a00, rc 0) 00000100:00100000:2.0:1787075798.722180:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:6700:x1873884700745216:12345-0@lo:101: Request processed in 128us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075798.722187:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787075798.722304:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700745216:0@lo:101: 00010000:00010000:0.0:1787075798.722318:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181497c00/0x859911ad6869f328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f32f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075798.722333:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181497c00/0x859911ad6869f328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f32f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075798.722544:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700745344:0@lo:501: 00000100:00100000:0.0:1787075798.722572:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075798.722582:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf05fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787075798.722623:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700745344 00000100:00100000:2.0:1787075798.722627:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700745344 00000100:00100000:2.0:1787075798.722751:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787075798.722759:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191062450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:6700:x1873884700745344:12345-0@lo:501: 00000100:00100000:2.0:1787075798.723077:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191062450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:6700:x1873884700745344:12345-0@lo:501: Request processed in 318us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075798.723084:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787075798.726161:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700745344:0@lo:501: 00000100:00100000:1.0:1787075798.726374:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700745472:0@lo:503: 00000100:00100000:1.0:1787075798.726479:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075798.726522:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bbabc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075798.726634:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700745472 00000100:00100000:0.0:1787075798.726674:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700745472 00000100:00100000:0.0:1787075798.726717:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787075798.726727:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:6700:x1873884700745472:12345-0@lo:503: 00000100:00100000:0.0:1787075798.726940:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:6700:x1873884700745472:12345-0@lo:503: Request processed in 214us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075798.726947:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787075798.727274:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700745472:0@lo:503: 00000040:00080000:3.0:1787075798.727805:0:6700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787075798.727870:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700745600:0@lo:502: 00000100:00100000:3.0:1787075798.727915:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075798.727951:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff996183ee1240 going to sleep for 11 seconds 00000100:00100000:0.0:1787075798.728033:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700745600 00000100:00100000:0.0:1787075798.728038:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700745600 00000100:00100000:0.0:1787075798.728067:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787075798.728074:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:6700:x1873884700745600:12345-0@lo:502: 00000100:00100000:0.0:1787075798.728422:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:6700:x1873884700745600:12345-0@lo:502: Request processed in 348us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075798.728542:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787075798.729766:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700745600:0@lo:502: 00000040:00080000:3.0:1787075798.730097:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787075798.730156:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787075798.730191:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787075798.730336:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787075798.730374:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787075798.730550:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787075798.730598:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787075798.730627:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787075798.730755:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787075798.730790:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787075798.730822:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787075798.730865:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787075798.730898:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787075798.730928:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787075798.730969:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787075798.730999:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787075798.731027:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787075798.731067:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787075798.731098:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787075798.731127:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787075798.731168:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787075798.731277:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787075798.731341:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787075798.731518:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787075798.731556:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787075798.731590:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787075798.731636:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787075798.734880:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787075798.734937:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700745728:0@lo:502: 00000100:00100000:3.0:1787075798.735049:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075798.735670:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff996183ee1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787075798.736537:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700745728 00000100:00100000:2.0:1787075798.736547:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700745728 00000100:00100000:2.0:1787075798.736665:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787075798.736677:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191060850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:6700:x1873884700745728:12345-0@lo:502: 00000100:00100000:2.0:1787075798.736931:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191060850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:6700:x1873884700745728:12345-0@lo:502: Request processed in 256us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075798.736938:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787075798.737035:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700745728:0@lo:502: 00000040:00080000:3.0:1787075798.737131:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787075798.737146:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787075798.737803:0:6724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787075798.737819:0:6724:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9961b0098000) 00000020:00000080:3.0:1787075798.737837:0:6724:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1787075798.737990:0:6724:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9961c14da000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787075798.737994:0:6724:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9961c14da000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787075798.737997:0:6724:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9961c14da000 3 00010000:00080000:3.0:1787075798.738022:0:6724:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9961bf086800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.150@tcp at head 00010000:00010000:3.0:1787075798.741799:0:6724:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1787075798.741931:0:6724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787075798.741979:0:6724:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787075798.741993:0:6724:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x859911ad6869f33d 00000100:00080000:3.0:1787075798.742004:0:6724:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787075798.742010:0:6724:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9961bf086800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1787075798.742052:0:6724:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9961b9de6a00 x1873884700745856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787075798.742107:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1873884700745856:0@lo:38: 00000100:00100000:3.0:1787075798.742183:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787075798.743129:0:6724:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787075798.743324:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700745856 00000100:00100000:1.0:1787075798.743336:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700745856 00000100:00100000:1.0:1787075798.743374:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787075798.743394:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1873884700745856:12345-0@lo:38: 00010000:00080000:1.0:1787075798.743421:0:5853:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:1.0:1787075798.743462:0:5853:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x859911ad6869f344 00000004:00100000:1.0:1787075798.743480:0:5853:0:(mdt_handler.c:7351:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787075798.743511:0:5853:0:(import.c:65:import_set_state_nolock()) ffff9961beb76000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787075798.743575:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873884700745856:12345-0@lo:38: Request processed in 192us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075798.743583:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787075798.743658:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9961b9de6a00 x1873884700745856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787075808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075798.743669:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787075798.743677:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787075798.743695:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787075798.743701:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787075798.743703:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961bf086800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787075798.743709:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1873884700745856:0@lo:38: 00000100:00100000:0.0:1787075798.746726:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787075798.746751:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700745984:0@lo:400: 00000100:00100000:0.0:1787075798.746817:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1787075798.748759:0:6724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:1.0:1787075798.750703:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700745984 00000100:00100000:1.0:1787075798.750717:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700745984 00000100:00100000:1.0:1787075798.750770:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787075798.750780:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700745984:12345-0@lo:400: 00000100:00100000:1.0:1787075798.750876:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700745984:12345-0@lo:400: Request processed in 97us (4058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075798.750883:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787075798.751352:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9961b9df9180 x1873884700745984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075798.751372:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700745984:0@lo:400: 00000020:01000000:2.0:1787075798.751679:0:6700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787075798.751713:0:6700:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787075798.751730:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181497c00/0x859911ad6869f328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f32f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.751742:0:6700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181497c00/0x859911ad6869f328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f32f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787075798.751790:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787075798.751793:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787075798.751794:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787075798.751795:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787075798.751801:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787075798.751802:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787075798.751803:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787075798.751805:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787075798.751806:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787075798.751807:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787075798.751809:0:6700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787075798.751812:0:6700:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787075798.751815:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787075798.751816:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787075798.751817:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787075798.751818:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787075798.751818:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787075798.751819:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787075798.751820:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787075798.751821:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787075798.751822:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787075798.751823:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787075798.751824:0:6700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787075798.751847:0:6700:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787075798.751863:0:6700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700746112:0@lo:253: 00000100:00100000:2.0:1787075798.751915:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075798.751952:0:6700:0:(client.c:2702:ptlrpc_set_wait()) set ffff996185fc13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075798.753395:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700746112 00000100:00100000:0.0:1787075798.753421:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700746112 00000100:00100000:0.0:1787075798.754392:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787075798.754403:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:6700:x1873884700746112:12345-0@lo:253: 20000000:01000000:0.0:1787075798.754588:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787075798.754604:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787075798.778849:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787075798.778869:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787075798.778941:0:5868:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787075798.778946:0:5868:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787075798.778971:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996190038a00/0x859911ad6869f34b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.778995:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996183be6a00/0x859911ad6869f2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f2a3 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.779004:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996190038a00/0x859911ad6869f34b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.779047:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996183be6a00/0x859911ad6869f2aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f2a3 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075798.779074:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996183be6a00/0x859911ad6869f2aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f2a3 expref: 13 pid: 5847 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075798.779090:0:5868:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1873884700746240:0@lo:104: 00000100:00100000:1.0:1787075798.779173:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075798.779200:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700746240 00000100:00100000:1.0:1787075798.779226:0:5868:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bbabc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075798.779275:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700746240 00000100:00100000:0.0:1787075798.779346:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787075798.779357:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:5868:x1873884700746240:12345-0@lo:104: 00010000:00010000:0.0:1787075798.779374:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f2a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f2aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075798.780083:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787075798.780093:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:5868:x1873884700746240:12345-0@lo:104: Request processed in 737us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075798.780103:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787075798.780139:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787075798.780147:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f2a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f2aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.780155:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038800 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:2.0:1787075798.780159:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f2a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f2aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.780167:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f2aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787075798.780174:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f2aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787075798.780192:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787075798.780227:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f2a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f2aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.780234:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787075798.780253:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f2a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f2aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.780261:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f2a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f2aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.780295:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075798.780298:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075798.780299:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075798.780317:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700746368:0@lo:103: 00000100:00100000:2.0:1787075798.780362:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075798.780416:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700746368 00000100:00100000:2.0:1787075798.780421:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700746368 00010000:00010000:2.0:1787075798.780452:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996183be6a00/0x859911ad6869f2aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f2a3 expref: 14 pid: 5847 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075798.780476:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787075798.780483:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a03c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:3311:x1873884700746368:12345-0@lo:103: 00010000:00010000:2.0:1787075798.780493:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075798.780499:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996183be6a00/0x859911ad6869f2aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f2a3 expref: 14 pid: 5847 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.780508:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996183be6a00/0x859911ad6869f2aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f2a3 expref: 14 pid: 5847 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.780533:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996190038a00/0x859911ad6869f34b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.780540:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996190038a00/0x859911ad6869f34b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787075798.780554:0:5838:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003245373s 00010000:00010000:2.0:1787075798.780558:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996190038a00/0x859911ad6869f34b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.780565:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996190038a00/0x859911ad6869f34b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.780572:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996190038a00/0x859911ad6869f34b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.780578:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996190038a00/0x859911ad6869f34b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.780583:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038a00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787075798.780587:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996190038a00/0x859911ad6869f34b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.780595:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996190038a00/0x859911ad6869f34b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.780603:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996190038a00/0x859911ad6869f34b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075798.780614:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075798.780674:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a03c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:3311:x1873884700746368:12345-0@lo:103: Request processed in 190us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075798.780687:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787075798.780752:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700746368:0@lo:103: 00010000:00010000:3.0:1787075798.781027:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996183be6a00/0x859911ad6869f2aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f2a3 expref: 13 pid: 5847 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075798.781038:0:5868:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1873884700746240:0@lo:104: 00010000:00010000:3.0:1787075798.781350:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996190038a00/0x859911ad6869f34b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.781362:0:5868:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996190038a00/0x859911ad6869f34b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.781368:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996190038a00/0x859911ad6869f34b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075798.781374:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996190038a00/0x859911ad6869f34b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075798.790903:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:6700:x1873884700746112:12345-0@lo:253: Request processed in 36489us (38974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075798.790924:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787075798.791019:0:6700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6700:1873884700746112:0@lo:253: 10000000:01000000:2.0:1787075798.791032:0:6700:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787075798.791036:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787075798.791037:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787075798.791039:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787075798.791040:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787075798.791041:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787075798.791042:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787075798.791043:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787075798.791045:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787075798.791047:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787075798.791048:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787075798.791050:0:6700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787075798.791134:0:6700:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787075798.796613:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787075798.796854:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787075798.798544:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787075798.798850:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787075798.799126:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787075798.799556:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787075798.800972:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1787075798.920956:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787075799.039114:0:6700:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787075799.039121:0:6700:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787075799.039154:0:6700:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787075799.039460:0:6700:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787075799.039478:0:6700:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787075799.039507:0:6700:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787075799.946191:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075800.975527:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075801.996601:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075803.016102:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787075803.341786:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787075803.341793:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9961a03a5800 from 21 10000000:01000000:3.0:1787075803.341798:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787075803.341842:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075803.341855:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075803.341879:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075803.341905:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700746496:0@lo:101: 00000100:00100000:3.0:1787075803.341979:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075803.342189:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961baed9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787075803.346136:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700746496 00000100:00100000:2.0:1787075803.346152:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700746496 00000100:00100000:2.0:1787075803.346229:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787075803.346240:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5849:x1873884700746496:12345-0@lo:101: 00010000:00010000:2.0:1787075803.346259:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075803.346279:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181522c00/0x859911ad6869f359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f352 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075803.346307:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181522c00/0x859911ad6869f359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f352 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075803.346320:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181522c00/0x859911ad6869f359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f352 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075803.346343:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522c00, rc 0) 00000100:00100000:2.0:1787075803.346420:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:5849:x1873884700746496:12345-0@lo:101: Request processed in 181us (4440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075803.346428:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787075803.346542:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700746496:0@lo:101: 00010000:00010000:3.0:1787075803.346561:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f352 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f359 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075803.346570:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f352 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f359 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075803.346673:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700746624:0@lo:501: 00000100:00100000:3.0:1787075803.346708:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075803.346745:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961baed9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787075803.346800:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700746624 00000100:00100000:2.0:1787075803.346804:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700746624 00000100:00100000:2.0:1787075803.346932:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787075803.346940:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:5849:x1873884700746624:12345-0@lo:501: 00000100:00100000:2.0:1787075803.347291:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:5849:x1873884700746624:12345-0@lo:501: Request processed in 351us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075803.347298:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787075803.347360:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700746624:0@lo:501: 00000100:00100000:1.0:1787075803.347392:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700746752:0@lo:503: 00000100:00100000:1.0:1787075803.347433:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075803.355586:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996182d69300 going to sleep for 11 seconds 00000100:00100000:3.0:1787075803.357412:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700746752 00000100:00100000:3.0:1787075803.357427:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700746752 00000100:00100000:3.0:1787075803.357490:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787075803.357499:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:5849:x1873884700746752:12345-0@lo:503: 00000100:00100000:3.0:1787075803.357927:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:5849:x1873884700746752:12345-0@lo:503: Request processed in 427us (10490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075803.357936:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787075803.358104:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700746752:0@lo:503: 00000100:00100000:1.0:1787075803.369635:0:6974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f54000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6974:1873884700746880:0@lo:502: 00000100:00100000:1.0:1787075803.369764:0:6974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075803.369806:0:6974:0:(client.c:2702:ptlrpc_set_wait()) set ffff996182d696c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787075803.370669:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700746880 00000100:00100000:3.0:1787075803.370678:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700746880 00000100:00100000:3.0:1787075803.370724:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787075803.370734:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:6974:x1873884700746880:12345-0@lo:502: 00000100:00100000:3.0:1787075803.371041:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:6974:x1873884700746880:12345-0@lo:502: Request processed in 307us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075803.371049:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787075803.374126:0:6974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f54000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6974:1873884700746880:0@lo:502: 00000100:00100000:2.0:1787075803.374259:0:6974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6974:1873884700747008:0@lo:502: 00000100:00100000:2.0:1787075803.374348:0:6974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075803.374403:0:6974:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961a03950c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787075803.374458:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700747008 00000100:00100000:3.0:1787075803.374465:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700747008 00000100:00100000:3.0:1787075803.374522:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787075803.374532:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:6974:x1873884700747008:12345-0@lo:502: 00000100:00100000:3.0:1787075803.374819:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:6974:x1873884700747008:12345-0@lo:502: Request processed in 288us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075803.374828:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787075803.374947:0:6974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6974:1873884700747008:0@lo:502: 00000040:00080000:2.0:1787075803.374972:0:6974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787075803.375150:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787075803.375169:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787075803.375179:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f352 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f359 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075803.375190:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f359 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787075803.375213:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787075803.375216:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9961a03a5800 from 4 10000000:01000000:3.0:1787075803.375219:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787075803.375249:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be6a00/0x859911ad6869f360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075803.375257:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996183be6a00/0x859911ad6869f360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075803.375266:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996183be6a00/0x859911ad6869f360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075803.375293:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700747136:0@lo:101: 00000100:00100000:3.0:1787075803.375323:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075803.375354:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961baed9000 going to sleep for 11 seconds 00000100:00100000:2.0:1787075803.375406:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700747136 00000100:00100000:2.0:1787075803.375411:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700747136 00000100:00100000:2.0:1787075803.376189:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787075803.376212:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:5849:x1873884700747136:12345-0@lo:101: 00010000:00010000:2.0:1787075803.376225:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075803.376242:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181522000/0x859911ad6869f367 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f360 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075803.376280:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181522000/0x859911ad6869f367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f360 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075803.376292:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181522000/0x859911ad6869f367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f360 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075803.376301:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522000, rc 0) 00000100:00100000:2.0:1787075803.376369:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:5849:x1873884700747136:12345-0@lo:101: Request processed in 161us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075803.376375:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787075803.376458:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700747136:0@lo:101: 00010000:00010000:1.0:1787075803.376473:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996183be6a00/0x859911ad6869f360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f367 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075803.376481:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996183be6a00/0x859911ad6869f360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f367 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075803.376538:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700747264:0@lo:256: 00000100:00100000:1.0:1787075803.376576:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075803.379671:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996182d693c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787075803.390624:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700747264 00000100:00100000:3.0:1787075803.390654:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700747264 00000100:00100000:3.0:1787075803.390724:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787075803.390735:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:5849:x1873884700747264:12345-0@lo:256: 20000000:01000000:3.0:1787075803.390762:0:5844:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787075803.390789:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787075803.390792:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787075803.390967:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:5849:x1873884700747264:12345-0@lo:256: Request processed in 233us (14387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075803.390975:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787075803.391048:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700747264:0@lo:256: 10000000:01000000:3.0:1787075803.391107:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787075803.391125:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be6a00/0x859911ad6869f360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f367 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075803.391137:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996183be6a00/0x859911ad6869f360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f367 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787075803.391146:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787075803.391148:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787075803.391151:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787075803.391186:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f36e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075803.391216:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f36e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075803.391226:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f36e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075803.391248:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700747392:0@lo:101: 00000100:00100000:3.0:1787075803.391283:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075803.391318:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961baed9780 going to sleep for 11 seconds 00000100:00100000:3.0:1787075803.391352:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700747392 00000100:00100000:3.0:1787075803.391357:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700747392 00000100:00100000:3.0:1787075803.391375:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787075803.391381:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619102a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:5849:x1873884700747392:12345-0@lo:101: 00010000:00010000:3.0:1787075803.391390:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075803.391403:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996183be6e00/0x859911ad6869f375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f36e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075803.391424:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996183be6e00/0x859911ad6869f375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f36e expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075803.391434:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996183be6e00/0x859911ad6869f375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f36e expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075803.391442:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996183be6e00, rc 0) 00000100:00100000:3.0:1787075803.391473:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619102a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700747392:12345-0@lo:101: Request processed in 92us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075803.391479:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787075803.391509:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700747392:0@lo:101: 00010000:00010000:3.0:1787075803.391526:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f36e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f375 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075803.391534:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f36e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f375 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075803.391582:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700747520:0@lo:501: 00000100:00100000:3.0:1787075803.391607:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075803.391621:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961baed9780 going to sleep for 11 seconds 00000100:00100000:3.0:1787075803.391632:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700747520 00000100:00100000:3.0:1787075803.391635:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700747520 00000100:00100000:3.0:1787075803.391679:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787075803.391685:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619102b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700747520:12345-0@lo:501: 00000100:00100000:3.0:1787075803.391942:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619102b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700747520:12345-0@lo:501: Request processed in 255us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075803.391949:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787075803.391978:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700747520:0@lo:501: 00000100:00100000:3.0:1787075803.392003:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700747648:0@lo:503: 00000100:00100000:3.0:1787075803.392037:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075803.392050:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961baed9780 going to sleep for 11 seconds 00000100:00100000:3.0:1787075803.392060:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700747648 00000100:00100000:3.0:1787075803.392063:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700747648 00000100:00100000:3.0:1787075803.392077:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787075803.392082:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619102bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700747648:12345-0@lo:503: 00000100:00100000:3.0:1787075803.392405:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619102bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700747648:12345-0@lo:503: Request processed in 321us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075803.392412:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787075803.392452:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700747648:0@lo:503: 00000100:00100000:3.0:1787075803.392696:0:6975:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6975:1873884700747776:0@lo:502: 00000100:00100000:3.0:1787075803.392730:0:6975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075803.392750:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700747776 00000100:00100000:3.0:1787075803.392754:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700747776 00000100:00100000:3.0:1787075803.392772:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787075803.392779:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619102b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:6975:x1873884700747776:12345-0@lo:502: 00000100:00100000:3.0:1787075803.392954:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619102b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:6975:x1873884700747776:12345-0@lo:502: Request processed in 176us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075803.392961:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787075803.392987:0:6975:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961893610c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787075803.392998:0:6975:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6975:1873884700747776:0@lo:502: 00000020:01000000:3.0:1787075803.393020:0:6975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787075803.393027:0:6975:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787075803.393033:0:6975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787075803.393036:0:6975:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787075803.393040:0:6975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787075803.393044:0:6975:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.150@tcp to nid 0x20000c0a8cc96 (192.168.204.150@tcp) 00000020:01000000:3.0:1787075803.393066:0:6975:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787075803.393069:0:6975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787075803.393084:0:6975:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9961b009cd40) 00000020:00000080:3.0:1787075803.393103:0:6975:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787075803.393108:0:6975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787075803.393172:0:6975:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787075803.393178:0:6975:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787075803.393190:0:6975:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x859911ad6869f383 00010000:00080000:3.0:1787075803.393231:0:6975:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9961b9cbe800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.150@tcp at head 00010000:00010000:3.0:1787075803.400730:0:6975:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1787075803.464250:0:6975:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787075803.464275:0:6975:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787075803.464792:0:6975:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787075803.464960:0:6975:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787075803.465010:0:6975:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787075803.465075:0:6975:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787075803.466872:0:6984:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787075803.466880:0:6984:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787075803.468578:0:6975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787075803.468591:0:6975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787075803.468624:0:6975:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787075803.468671:0:6975:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x859911ad6869f38a 00000100:00080000:3.0:1787075803.468681:0:6975:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787075803.468687:0:6975:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9961b9cbe800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1787075803.468722:0:6975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9961b9de7800 x1873884700747904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787075803.468743:0:6975:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787075803.468802:0:6975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787075803.468806:0:6975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787075803.468808:0:6975:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787075803.468811:0:6975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787075803.468814:0:6975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787075803.468816:0:6975:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787075803.468819:0:6975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787075803.468821:0:6975:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787075803.468848:0:6975:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6975:1873884700748032:0@lo:502: 00000100:00100000:3.0:1787075803.468925:0:6975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075803.468972:0:6975:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961893616c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787075803.469055:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700748032 00000100:00100000:3.0:1787075803.469062:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700748032 00000100:00100000:3.0:1787075803.469104:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787075803.469113:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:6975:x1873884700748032:12345-0@lo:502: 00000100:00100000:3.0:1787075803.469340:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:6975:x1873884700748032:12345-0@lo:502: Request processed in 227us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075803.469348:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787075803.469389:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700748160:0@lo:400: 00000100:00100000:3.0:1787075803.469418:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075803.469455:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700748288:0@lo:400: 00000100:00100000:3.0:1787075803.469478:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075803.469517:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700748160 00000100:00100000:3.0:1787075803.469521:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700748160 00000100:00100000:3.0:1787075803.469543:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700748288 00000100:00100000:3.0:1787075803.469546:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700748288 00000100:00100000:3.0:1787075803.469568:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787075803.469574:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700748160:12345-0@lo:400: 00000100:00100000:3.0:1787075803.469610:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700748160:12345-0@lo:400: Request processed in 36us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075803.469616:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787075803.469629:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787075803.469634:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700748288:12345-0@lo:400: 00000100:00100000:3.0:1787075803.469684:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700748288:12345-0@lo:400: Request processed in 49us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075803.469690:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787075803.469710:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787075803.469734:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9de7480 x1873884700748288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075803.469747:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700748288:0@lo:400: 00010000:00080000:3.0:1787075803.469782:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9de5880 x1873884700748160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075803.469791:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700748160:0@lo:400: 00000100:00100000:3.0:1787075803.469808:0:6975:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:6975:1873884700748032:0@lo:502: 00000020:01000000:3.0:1787075803.469829:0:6975:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787075803.469834:0:6975:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787075803.469836:0:6975:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787075803.469841:0:6975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1787075803.469938:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787075803.469956:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787075803.469967:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f36e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f375 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075803.469977:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f36e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f375 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787075803.469986:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787075803.469988:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9961b009b380 from 1 10000000:01000000:3.0:1787075803.469991:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787075803.470014:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be7c00/0x859911ad6869f391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075803.470022:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996183be7c00/0x859911ad6869f391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075803.470032:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996183be7c00/0x859911ad6869f391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075803.470046:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700748416:0@lo:101: 00000100:00100000:3.0:1787075803.470078:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075803.470100:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961893616c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075803.470106:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700748416 00000100:00100000:0.0:1787075803.470111:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700748416 00000100:00100000:0.0:1787075803.470136:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787075803.470143:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700748416:12345-0@lo:101: 00010000:00010000:0.0:1787075803.470151:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075803.470164:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181497e00/0x859911ad6869f398 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f391 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075803.470185:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181497e00/0x859911ad6869f398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f391 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075803.470214:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181497e00/0x859911ad6869f398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f391 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075803.470223:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181497e00, rc 0) 00000100:00100000:0.0:1787075803.470259:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:5849:x1873884700748416:12345-0@lo:101: Request processed in 117us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075803.470266:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787075803.470286:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700747904:0@lo:8: 00000100:00100000:1.0:1787075803.470320:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075803.470597:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700747904 00000100:00100000:0.0:1787075803.470602:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700747904 00000100:00100000:0.0:1787075803.470623:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787075803.470628:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1873884700747904:12345-0@lo:8: 00010000:00080000:0.0:1787075803.470665:0:6704:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:0.0:1787075803.470690:0:6704:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x859911ad6869f39f 00002000:00100000:0.0:1787075803.470800:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9961bf060000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113901 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787075803.470805:0:6704:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787075803.470809:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787075803.471150:0:6704:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787075803.471313:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787075803.471341:0:6704:0:(import.c:65:import_set_state_nolock()) ffff9961bf063000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787075803.471485:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1873884700747904:12345-0@lo:8: Request processed in 854us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075803.471492:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787075803.471518:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9de7800 x1873884700747904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787075813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075803.471528:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787075803.471535:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787075803.471542:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787075803.471547:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787075803.471549:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961b9cbe800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787075803.471561:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787075803.471566:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700747904:0@lo:8: 00000100:00100000:3.0:1787075803.471856:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700748416:0@lo:101: 00010000:00010000:3.0:1787075803.471875:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996183be7c00/0x859911ad6869f391 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f398 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075803.471886:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996183be7c00/0x859911ad6869f391 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f398 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075803.471937:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700748544:0@lo:501: 00000100:00100000:3.0:1787075803.471970:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075803.471996:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961893616c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787075803.472014:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700748544 00000100:00100000:3.0:1787075803.472019:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700748544 00000100:00100000:3.0:1787075803.472046:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787075803.472054:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:5849:x1873884700748544:12345-0@lo:501: 00000100:00100000:3.0:1787075803.472268:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:5849:x1873884700748544:12345-0@lo:501: Request processed in 214us (297us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787075803.472275:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787075803.472308:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700748544:0@lo:501: 10000000:01000000:3.0:1787075803.472331:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787075803.472411:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be7c00/0x859911ad6869f391 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f398 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075803.472420:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996183be7c00/0x859911ad6869f391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f398 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787075803.472454:0:6984:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787075803.472574:0:6984:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 185447933242ns, next at 0ns, rc = 0 00000004:00080000:3.0:1787075803.551571:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787075803.588264:0:6986:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787075803.588268:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787075803.588297:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700748672:0@lo:13: 00000100:00100000:0.0:1787075803.588297:0:6986:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6986:1873884700748800:0@lo:7: 00000100:00100000:0.0:1787075803.588459:0:6986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075803.588523:0:6986:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191869300 going to sleep for 11 seconds 00000100:00100000:3.0:1787075803.588559:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075803.588595:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700748800 00000100:00100000:1.0:1787075803.588604:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700748800 00000100:00100000:1.0:1787075803.588682:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787075803.588690:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6986:x1873884700748800:12345-0@lo:7: 00000100:00080000:3.0:1787075803.588710:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787075803.589275:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700748672 00000100:00100000:0.0:1787075803.589281:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700748672 00000100:00100000:0.0:1787075803.589307:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787075803.589314:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1873884700748672:12345-0@lo:13: 00002000:00000024:0.0:1787075803.589398:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787075803.589457:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1873884700748672:12345-0@lo:13: Request processed in 142us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075803.589463:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787075803.590300:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9df8380 x1873884700748672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075803.590323:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700748672:0@lo:13: 00002000:00080000:1.0:1787075803.598771:0:6706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787075803.598779:0:6706:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787075803.598925:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6986:x1873884700748800:12345-0@lo:7: Request processed in 10231us (10462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075803.598938:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787075803.599088:0:6986:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9dfb100 x1873884700748800/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787075819 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075803.599104:0:6986:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6986:1873884700748800:0@lo:7: 00000004:00080000:0.0:1787075803.599120:0:6986:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787075803.599318:0:6986:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6986:1873884700748928:0@lo:5: 00000100:00100000:0.0:1787075803.599432:0:6986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075803.599523:0:6986:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961894a1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787075803.599599:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700748928 00000100:00100000:1.0:1787075803.599607:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700748928 00000100:00100000:1.0:1787075803.599716:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787075803.599727:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6986:x1873884700748928:12345-0@lo:5: 00002000:00080000:1.0:1787075803.599752:0:6705:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787075803.599756:0:6705:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787075803.600000:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6986:x1873884700748928:12345-0@lo:5: Request processed in 275us (566us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787075803.600014:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787075803.600082:0:6986:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9dfb100 x1873884700748928/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787075819 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075803.600095:0:6986:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6986:1873884700748928:0@lo:5: 00000004:00080000:0.0:1787075803.600105:0:6986:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787075803.600130:0:6986:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6986:1873884700749056:0@lo:700: 00000100:00100000:0.0:1787075803.600239:0:6986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075803.600259:0:6986:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961894a1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787075803.600280:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700749056 00000100:00100000:0.0:1787075803.600284:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700749056 00000100:00100000:0.0:1787075803.600313:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787075803.600328:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6986:x1873884700749056:12345-0@lo:700: 00000100:00100000:0.0:1787075803.600435:0:6712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6712:1873884700749184:0@lo:700: 00000100:00100000:0.0:1787075803.600483:0:6712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075803.600503:0:6712:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961894a1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787075803.600527:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700749184 00000100:00100000:0.0:1787075803.600531:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700749184 00000100:00100000:0.0:1787075803.600560:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787075803.600567:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6712:x1873884700749184:12345-0@lo:700: 40000000:02000000:2.0:1787075803.630924:0:5859:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787075803.638881:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6712:x1873884700749184:12345-0@lo:700: Request processed in 38304us (38388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075803.638897:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787075803.639097:0:6712:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9dfa680 x1873884700749184/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787075819 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075803.639114:0:6712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6712:1873884700749184:0@lo:700: 40000000:02000000:1.0:1787075803.639128:0:6712:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:2.0:1787075803.727607:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787075803.727631:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1787075803.727972:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6986:x1873884700749056:12345-0@lo:700: Request processed in 127640us (127728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075803.727992:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787075803.728161:0:6986:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9dfbb80 x1873884700749056/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787075819 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075803.728172:0:6986:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787075803.728199:0:6986:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6986:1873884700749056:0@lo:700: 00000004:02000040:0.0:1787075803.761739:0:6986:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787075803.773978:0:6986:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6986:1873884700749312:0@lo:5: 00000100:00100000:0.0:1787075803.774183:0:6986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075803.774269:0:6986:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961894a16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787075803.777151:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700749312 00000100:00100000:1.0:1787075803.777166:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700749312 00000100:00100000:1.0:1787075803.777245:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787075803.777256:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6986:x1873884700749312:12345-0@lo:5: 00002000:00080000:1.0:1787075803.794505:0:6706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787075803.794529:0:6706:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787075803.805976:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6986:x1873884700749312:12345-0@lo:5: Request processed in 28716us (31786us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787075803.805989:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787075803.806047:0:6986:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9dfbb80 x1873884700749312/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787075819 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075803.806064:0:6986:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6986:1873884700749312:0@lo:5: 00000004:00080000:1.0:1787075803.806080:0:6986:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1787075804.043543:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787075804.877798:0:7071:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787075805.069563:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075806.089122:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075807.112679:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075808.136764:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787075808.975422:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700749440:0@lo:13: 00000100:00100000:3.0:1787075808.975492:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075808.975516:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700749696:0@lo:400: 00000100:00100000:3.0:1787075808.975547:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700749952:0@lo:400: 00000100:00100000:0.0:1787075808.975560:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075808.975582:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075808.975601:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787075808.975608:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787075808.975612:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700749824:0@lo:400: 00000100:00100000:3.0:1787075808.975620:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700749568:0@lo:400: 00000100:00100000:0.0:1787075808.975662:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075808.976292:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700749952 00000100:00100000:1.0:1787075808.976301:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700749952 00000100:00100000:1.0:1787075808.976357:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787075808.976373:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1873884700749952:12345-0@lo:400: 00000100:00100000:1.0:1787075808.979190:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1873884700749952:12345-0@lo:400: Request processed in 2809us (3598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075808.979206:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787075808.979245:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787075808.979331:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787075808.979389:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9de7800 x1873884700749952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075808.979395:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700749568 00000100:00100000:0.0:1787075808.979404:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700749568 00000100:00100000:3.0:1787075808.979405:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700749952:0@lo:400: 00000100:00100000:3.0:1787075808.979451:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700749440 00000100:00100000:3.0:1787075808.979456:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700749440 00000100:00100000:3.0:1787075808.979490:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787075808.979497:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1873884700749440:12345-0@lo:13: 00002000:00000024:3.0:1787075808.979540:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787075808.979586:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1873884700749440:12345-0@lo:13: Request processed in 88us (4094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075808.979592:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787075808.979610:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700749696 00000100:00100000:3.0:1787075808.979614:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700749696 00000100:00100000:3.0:1787075808.979635:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700749824 00000100:00100000:3.0:1787075808.979652:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700749824 00000100:00100000:3.0:1787075808.979675:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787075808.979681:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700749696:12345-0@lo:400: 00000100:00100000:3.0:1787075808.979719:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700749696:12345-0@lo:400: Request processed in 38us (4161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075808.979725:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787075808.979736:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787075808.979741:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700749824:12345-0@lo:400: 00000100:00100000:3.0:1787075808.979768:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700749824:12345-0@lo:400: Request processed in 26us (4106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075808.979773:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787075808.979824:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9df9500 x1873884700749440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075808.979839:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700749440:0@lo:13: 00000100:00100000:3.0:1787075808.983793:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787075808.983814:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:3311:x1873884700749568:12345-0@lo:400: 00000100:00100000:3.0:1787075808.983916:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:3311:x1873884700749568:12345-0@lo:400: Request processed in 107us (4584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075808.983925:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1787075808.987817:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075808.993881:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700749568:0@lo:400: 00010000:00080000:3.0:1787075808.999957:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9de6d80 x1873884700749824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075808.999978:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700749824:0@lo:400: 00010000:00080000:3.0:1787075808.999994:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9de7480 x1873884700749696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075809.000004:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700749696:0@lo:400: 00000001:00080000:2.0:1787075809.056027:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787075809.160360:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075810.184449:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075811.208073:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075812.235787:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075813.256249:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787075814.093447:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700750080:0@lo:400: 00000100:00100000:3.0:1787075814.093520:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075814.093570:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787075814.093577:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700750464:0@lo:400: 00000100:00100000:3.0:1787075814.093603:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075814.093665:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700750208:0@lo:400: 00000100:00100000:3.0:1787075814.093692:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075814.093712:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787075814.093718:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700750336:0@lo:400: 00000100:00100000:3.0:1787075814.093738:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075814.093776:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700750080 00000100:00100000:3.0:1787075814.093783:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700750080 00000100:00100000:3.0:1787075814.093827:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787075814.093835:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:3312:x1873884700750080:12345-0@lo:400: 00000100:00100000:3.0:1787075814.093885:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:3312:x1873884700750080:12345-0@lo:400: Request processed in 50us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075814.093892:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787075814.093923:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700750208 00000100:00100000:3.0:1787075814.093934:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700750208 00000100:00100000:3.0:1787075814.093958:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700750336 00000100:00100000:3.0:1787075814.093961:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700750336 00000100:00100000:3.0:1787075814.093995:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787075814.094002:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700750208:12345-0@lo:400: 00000100:00100000:3.0:1787075814.094039:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700750208:12345-0@lo:400: Request processed in 38us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075814.094045:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787075814.094057:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787075814.094062:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700750336:12345-0@lo:400: 00000100:00100000:3.0:1787075814.094089:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700750336:12345-0@lo:400: Request processed in 27us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075814.094094:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787075814.094120:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787075814.094270:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787075814.094282:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700750592:0@lo:13: 00000100:00100000:2.0:1787075814.094319:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075814.094354:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700750592 00000100:00100000:2.0:1787075814.094358:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700750592 00010000:00080000:3.0:1787075814.094412:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9de5880 x1873884700750336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075814.094426:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700750336:0@lo:400: 00010000:00080000:3.0:1787075814.094437:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9de6d80 x1873884700750208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075814.094445:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700750208:0@lo:400: 00000100:00100000:3.0:1787075814.094476:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700750080:0@lo:400: 00000100:00100000:1.0:1787075814.095334:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700750464 00000100:00100000:1.0:1787075814.095342:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700750464 00000100:00100000:1.0:1787075814.095383:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787075814.095392:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1873884700750464:12345-0@lo:400: 00000100:00100000:1.0:1787075814.095453:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1873884700750464:12345-0@lo:400: Request processed in 61us (1847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075814.095460:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787075814.095500:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9de7800 x1873884700750464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075814.095509:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787075814.095522:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700750464:0@lo:400: 00000100:00100000:2.0:1787075814.102418:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787075814.102433:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700750592:12345-0@lo:13: 00002000:00000024:2.0:1787075814.102476:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075814.102579:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700750592:12345-0@lo:13: Request processed in 150us (8259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075814.102585:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787075814.102609:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787075814.102670:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b00ff480 x1873884700750592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787075814.102691:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700750592:0@lo:13: 00010000:00010000:0.0:1787075814.283721:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075815.308361:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075816.328483:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787075816.512949:0:7639:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787075816.512955:0:7639:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787075816.513194:0:7639:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9961bf681000 00000020:01000004:2.0:1787075816.513282:0:7639:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787075816.513301:0:7639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787075816.513322:0:7639:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff996191838000) 00000020:00000080:2.0:1787075816.513461:0:7639:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787075816.553920:0:7639:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787075816.554374:0:7639:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787075816.579036:0:7639:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787075816.583353:0:7639:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787075816.583391:0:7639:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787075816.583450:0:7639:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787075816.583475:0:7639:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787075816.584098:0:7639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787075816.584116:0:7639:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787075816.584130:0:7639:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x859911ad6869f3ad 00000020:01000004:0.0:1787075816.584140:0:7639:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787075816.584165:0:7639:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.150@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787075816.584169:0:7639:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787075816.584176:0:7639:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787075816.584210:0:7639:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787075816.584215:0:7639:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787075816.600090:0:7639:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787075816.600141:0:7639:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.150@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787075816.600145:0:7639:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787075816.600147:0:7639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787075816.600149:0:7639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787075816.600151:0:7639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787075816.600152:0:7639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787075816.600153:0:7639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787075816.600156:0:7639:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787075816.600157:0:7639:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787075816.600159:0:7639:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787075816.600166:0:7639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787075816.600167:0:7639:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787075816.600172:0:7639:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787075816.600174:0:7639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787075816.600176:0:7639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787075816.600177:0:7639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787075816.600178:0:7639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787075816.600179:0:7639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787075816.600180:0:7639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787075816.600181:0:7639:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787075816.600182:0:7639:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787075816.600183:0:7639:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787075816.600184:0:7639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787075816.600185:0:7639:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787075816.600230:0:7639:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787075816.600258:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700750720:0@lo:253: 00000100:00100000:0.0:1787075816.600356:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075816.600496:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9c8cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787075816.600553:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700750720 00000100:00100000:1.0:1787075816.600563:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700750720 00000100:00100000:1.0:1787075816.600630:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787075816.600864:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:7639:x1873884700750720:12345-0@lo:253: 20000000:01000000:1.0:1787075816.600906:0:5847:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787075816.600910:0:5847:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787075816.600916:0:5847:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787075816.600927:0:5847:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787075816.602260:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787075816.602501:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787075816.602515:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787075816.602552:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787075816.602559:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787075816.602584:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787075816.602626:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787075816.603205:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787075816.603229:0:5847:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.150@tcp 20000000:01000000:1.0:1787075816.603231:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.150@tcp (null) (null) (null) 00000040:00080000:1.0:1787075816.603276:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787075816.603284:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787075816.603325:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787075816.603333:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.150@tcp (null) (null) 00000040:00080000:1.0:1787075816.603359:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787075816.603368:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787075816.603392:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787075816.603434:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787075816.604621:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787075816.604838:0:5847:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.150@tcp 20000000:01000000:1.0:1787075816.604841:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.150@tcp (null) (null) (null) 00000040:00080000:1.0:1787075816.604881:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787075816.604890:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787075816.604916:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787075816.604923:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.150@tcp (null) (null) 00000040:00080000:1.0:1787075816.604963:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787075816.604973:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787075816.605015:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787075816.605049:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787075816.605070:0:5847:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787075816.605084:0:5847:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787075816.605088:0:5847:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787075816.605107:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787075816.605110:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787075816.605152:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787075816.605155:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787075816.606123:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787075816.606235:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787075816.606271:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787075816.607098:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787075816.607146:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787075816.607326:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1787075816.607342:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787075816.607345:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787075816.616042:0:7642:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1787075816.616178:0:7642:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1787075816.616289:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787075816.618032:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787075816.618093:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787075816.618179:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787075816.618310:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787075816.618314:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787075816.628117:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787075816.629441:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787075816.629500:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787075816.629606:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787075816.629624:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787075816.629628:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787075816.631891:0:7644:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1787075816.632068:0:7644:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1787075816.632127:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1787075816.632918:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1787075816.632990:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1787075816.633029:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1787075816.633051:0:5847:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1787075816.633055:0:5847:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1787075816.633070:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787075816.633097:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996181497600/0x859911ad6869f3b4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.633123:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181523c00/0x859911ad6869f305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f2fe expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.633132:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181522a00/0x859911ad6869f32f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f328 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.633139:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181522c00/0x859911ad6869f359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f352 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.633158:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996183be6e00/0x859911ad6869f375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f36e expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.633167:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181497e00/0x859911ad6869f398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f391 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.633174:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996181497600/0x859911ad6869f3b4 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.634006:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181497e00/0x859911ad6869f398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f391 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.634032:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996181497e00/0x859911ad6869f398 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f391 expref: 16 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075816.634055:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1873884700750848:0@lo:104: 00000100:00100000:0.0:1787075816.634167:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787075816.634256:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996183be6e00/0x859911ad6869f375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f36e expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.634265:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996183be6e00/0x859911ad6869f375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f36e expref: 16 pid: 5844 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075816.634273:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfa680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1873884700750976:0@lo:104: 00010000:00010000:0.0:1787075816.634301:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181522c00/0x859911ad6869f359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f352 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.634309:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996181522c00/0x859911ad6869f359 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f352 expref: 16 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075816.634338:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1873884700751104:0@lo:104: 00010000:00010000:0.0:1787075816.634367:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181522a00/0x859911ad6869f32f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f328 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.634375:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996181522a00/0x859911ad6869f32f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f328 expref: 16 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075816.634870:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787075816.634897:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075816.634931:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075816.634956:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700750848 00000100:00100000:1.0:1787075816.634965:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700750848 00000100:00100000:1.0:1787075816.635014:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700750976 00000100:00100000:1.0:1787075816.635018:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700750976 00000100:00100000:1.0:1787075816.635029:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700751104 00000100:00100000:1.0:1787075816.635032:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700751104 00000100:00100000:1.0:1787075816.635049:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787075816.635061:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996182dfe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+5:5847:x1873884700750848:12345-0@lo:104: 00010000:00010000:1.0:1787075816.635081:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996183be7c00/0x859911ad6869f391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f398 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.635156:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787075816.635163:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996182dfe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+5:5847:x1873884700750848:12345-0@lo:104: Request processed in 103us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075816.635525:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1873884700751232:0@lo:104: 00000100:00100000:0.0:1787075816.635656:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787075816.635729:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181523c00/0x859911ad6869f305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f2fe expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.635741:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996181523c00/0x859911ad6869f305 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f2fe expref: 16 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075816.635750:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1873884700751360:0@lo:104: 00000100:00100000:0.0:1787075816.635774:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075816.635786:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9c8c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075816.635816:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1873884700750848:0@lo:104: 00000100:00100000:1.0:1787075816.636244:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787075816.636310:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700751232 00000100:00100000:1.0:1787075816.636316:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700751232 00000100:00100000:1.0:1787075816.636342:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700751360 00000100:00100000:1.0:1787075816.636345:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700751360 00000100:00100000:1.0:1787075816.636358:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787075816.636366:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+6:5847:x1873884700750976:12345-0@lo:104: 00010000:00010000:1.0:1787075816.636380:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f36e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f375 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.636448:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787075816.636455:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+6:5847:x1873884700750976:12345-0@lo:104: Request processed in 90us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075816.636463:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787075816.636491:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787075816.636499:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+5:5847:x1873884700751104:12345-0@lo:104: 00010000:00010000:1.0:1787075816.636508:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f359 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.636538:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787075816.636543:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+5:5847:x1873884700751104:12345-0@lo:104: Request processed in 46us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075816.636549:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787075816.636561:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787075816.637321:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfa680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1873884700750976:0@lo:104: 00000100:00100000:0.0:1787075816.637331:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1873884700751104:0@lo:104: 00000100:00100000:1.0:1787075816.637390:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+4:5847:x1873884700751232:12345-0@lo:104: 00010000:00010000:1.0:1787075816.637403:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996181497c00/0x859911ad6869f328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f32f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637492:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787075816.637499:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+4:5847:x1873884700751232:12345-0@lo:104: Request processed in 932us (1936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075816.637507:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787075816.637528:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787075816.637534:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:5847:x1873884700751360:12345-0@lo:104: 00010000:00010000:1.0:1787075816.637545:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996190039600/0x859911ad6869f2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f305 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637584:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787075816.637589:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:5847:x1873884700751360:12345-0@lo:104: Request processed in 56us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075816.637595:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787075816.637616:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787075816.637624:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996183be7c00/0x859911ad6869f391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f398 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637633:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996183be7c00 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787075816.637655:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996183be7c00/0x859911ad6869f391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f398 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637666:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996183be7c00/0x859911ad6869f391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f398 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787075816.637675:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996183be7c00/0x859911ad6869f391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f398 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075816.637682:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787075816.637731:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996183be7c00/0x859911ad6869f391 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f398 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637739:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787075816.637768:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996183be7c00/0x859911ad6869f391 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f398 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637776:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996183be7c00/0x859911ad6869f391 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f398 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637792:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787075816.637795:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f36e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f375 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637800:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996183be6800 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787075816.637803:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f36e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f375 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637810:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f36e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f375 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787075816.637816:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f36e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f375 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075816.637822:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787075816.637834:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f36e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f375 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637840:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787075816.637845:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f36e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f375 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637862:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f36e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f375 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637872:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787075816.637875:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f359 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637881:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996183be6000 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787075816.637884:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f359 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637891:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f359 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787075816.637898:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f359 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075816.637903:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787075816.637916:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f352 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f359 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637921:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787075816.637952:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f352 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f359 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637959:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996183be6000/0x859911ad6869f352 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f359 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637969:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787075816.637977:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181497c00/0x859911ad6869f328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f32f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637984:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181497c00 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787075816.637987:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181497c00/0x859911ad6869f328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f32f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.637994:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181497c00/0x859911ad6869f328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f32f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787075816.637999:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181497c00/0x859911ad6869f328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f32f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075816.638004:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787075816.638019:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181497c00/0x859911ad6869f328 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f32f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.638025:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787075816.638030:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181497c00/0x859911ad6869f328 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f32f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.638037:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181497c00/0x859911ad6869f328 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f32f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.638047:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787075816.638050:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996190039600/0x859911ad6869f2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f305 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.638056:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190039600 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787075816.638059:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996190039600/0x859911ad6869f2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f305 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.638075:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996190039600/0x859911ad6869f2fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f305 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787075816.638081:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996190039600/0x859911ad6869f2fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f305 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075816.638086:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787075816.638098:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996190039600/0x859911ad6869f2fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f305 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.638103:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787075816.638107:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996190039600/0x859911ad6869f2fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f305 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.638113:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996190039600/0x859911ad6869f2fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f305 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.638131:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075816.638133:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075816.638135:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075816.638142:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075816.638157:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700751744:0@lo:103: 00000100:00100000:1.0:1787075816.638202:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075816.638249:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787075816.638255:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700751872:0@lo:103: 00000100:00100000:1.0:1787075816.638277:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075816.638314:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700751744 00000100:00100000:1.0:1787075816.638322:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700751744 00010000:00010000:1.0:1787075816.638352:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181522c00/0x859911ad6869f359 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f352 expref: 17 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075816.638392:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700751872 00000100:00100000:1.0:1787075816.638395:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700751872 00010000:00010000:1.0:1787075816.638408:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181522a00/0x859911ad6869f32f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f328 expref: 18 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075816.638421:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787075816.638429:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:3311:x1873884700751744:12345-0@lo:103: 00010000:00010000:1.0:1787075816.638441:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075816.638449:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181522c00/0x859911ad6869f359 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f352 expref: 18 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.638458:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181522c00/0x859911ad6869f359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f352 expref: 18 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.638476:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181522c00/0x859911ad6869f359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f352 expref: 18 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.638493:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075816.638524:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:3311:x1873884700751744:12345-0@lo:103: Request processed in 96us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075816.638531:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787075816.638544:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787075816.638550:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:3311:x1873884700751872:12345-0@lo:103: 00010000:00010000:1.0:1787075816.638558:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075816.638561:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181522a00/0x859911ad6869f32f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f328 expref: 16 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.638570:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181522a00/0x859911ad6869f32f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f328 expref: 16 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.638585:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075816.638606:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:3311:x1873884700751872:12345-0@lo:103: Request processed in 57us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075816.638613:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787075816.638674:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700751872:0@lo:103: 00000100:00100000:1.0:1787075816.638685:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700751744:0@lo:103: 00000100:00100000:3.0:1787075816.639095:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700751488:0@lo:103: 00000100:00100000:3.0:1787075816.639136:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075816.639172:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700752000:0@lo:103: 00000100:00100000:3.0:1787075816.639193:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075816.639217:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787075816.639223:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700751616:0@lo:103: 00000100:00100000:3.0:1787075816.639241:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075816.639269:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700751488 00000100:00100000:3.0:1787075816.639277:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700751488 00010000:00010000:3.0:1787075816.639299:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181497e00/0x859911ad6869f398 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f391 expref: 16 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075816.639317:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700752000 00000100:00100000:3.0:1787075816.639319:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700752000 00010000:00010000:3.0:1787075816.639330:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181523c00/0x859911ad6869f305 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f2fe expref: 17 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075816.639339:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700751616 00000100:00100000:3.0:1787075816.639342:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700751616 00010000:00010000:3.0:1787075816.639352:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996183be6e00/0x859911ad6869f375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f36e expref: 18 pid: 5844 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075816.639364:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787075816.639370:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:3313:x1873884700751488:12345-0@lo:103: 00010000:00010000:3.0:1787075816.639380:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075816.639385:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181497e00/0x859911ad6869f398 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f391 expref: 18 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.639396:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181497e00/0x859911ad6869f398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f391 expref: 18 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.639418:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181497e00/0x859911ad6869f398 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f391 expref: 18 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.639430:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075816.639459:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:3313:x1873884700751488:12345-0@lo:103: Request processed in 89us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075816.639466:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787075816.639492:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787075816.639498:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:3313:x1873884700752000:12345-0@lo:103: 00010000:00010000:3.0:1787075816.639505:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075816.639511:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181523c00/0x859911ad6869f305 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f2fe expref: 16 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.639519:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181523c00/0x859911ad6869f305 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f2fe expref: 16 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.639529:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075816.639549:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:3313:x1873884700752000:12345-0@lo:103: Request processed in 51us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075816.639555:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787075816.639634:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787075816.639664:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:3313:x1873884700751616:12345-0@lo:103: 00010000:00010000:3.0:1787075816.639673:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075816.639677:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996183be6e00/0x859911ad6869f375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f36e expref: 15 pid: 5844 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.639687:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996183be6e00/0x859911ad6869f375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f36e expref: 15 pid: 5844 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.639703:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996183be6e00/0x859911ad6869f375 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f36e expref: 15 pid: 5844 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.639717:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996181497600/0x859911ad6869f3b4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.639725:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181497600/0x859911ad6869f3b4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.639742:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996181497600/0x859911ad6869f3b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.639749:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996181497600/0x859911ad6869f3b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.639756:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996181497600/0x859911ad6869f3b4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.639764:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996181497600/0x859911ad6869f3b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.639771:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181497600 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787075816.639776:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996181497600/0x859911ad6869f3b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.639784:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996181497600/0x859911ad6869f3b4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.639793:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996181497600/0x859911ad6869f3b4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.639814:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075816.639838:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:3313:x1873884700751616:12345-0@lo:103: Request processed in 198us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075816.639844:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787075816.639877:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700751616:0@lo:103: 00000100:00100000:3.0:1787075816.639887:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700751488:0@lo:103: 00000100:00100000:3.0:1787075816.639894:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700752000:0@lo:103: 00010000:00010000:0.0:1787075816.640227:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181522a00/0x859911ad6869f32f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f328 expref: 13 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075816.640243:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1873884700751232:0@lo:104: 00010000:00010000:0.0:1787075816.640257:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181523c00/0x859911ad6869f305 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f2fe expref: 12 pid: 5847 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075816.640280:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1873884700751360:0@lo:104: 00010000:00010000:0.0:1787075816.640309:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996181497600/0x859911ad6869f3b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.640321:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996181497600/0x859911ad6869f3b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.640327:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996181497600/0x859911ad6869f3b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.640334:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181497600/0x859911ad6869f3b4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787075816.640354:0:5847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787075816.710294:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:7639:x1873884700750720:12345-0@lo:253: Request processed in 109637us (109920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075816.710318:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787075816.710486:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700750720:0@lo:253: 10000000:01000000:0.0:1787075816.710507:0:7639:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787075816.710510:0:7639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787075816.710513:0:7639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787075816.710515:0:7639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787075816.710516:0:7639:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787075816.710517:0:7639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787075816.710518:0:7639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787075816.710520:0:7639:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787075816.710522:0:7639:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787075816.710524:0:7639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787075816.710525:0:7639:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787075816.710556:0:7639:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9961bf681000 from lustre-OST0001 10000000:01000000:0.0:1787075816.710699:0:7639:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787075816.710704:0:7639:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787075816.710716:0:7639:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9961b009b380 local copy 10000000:01000000:0.0:1787075816.710721:0:7639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787075816.710795:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f3bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.710810:0:7639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f3bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.710821:0:7639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f3bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075816.710847:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700752128:0@lo:101: 00000100:00100000:0.0:1787075816.710900:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075816.710977:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9c8c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787075816.711104:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700752128 00000100:00100000:3.0:1787075816.711113:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700752128 00000100:00100000:3.0:1787075816.711173:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787075816.711312:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+11:7639:x1873884700752128:12345-0@lo:101: 00010000:00010000:3.0:1787075816.711331:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075816.711352:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996183be6e00/0x859911ad6869f3c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f3bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.711384:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996183be6e00/0x859911ad6869f3c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f3bb expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.711398:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996183be6e00/0x859911ad6869f3c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f3bb expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.711408:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996183be6e00, rc 0) 00000100:00100000:3.0:1787075816.711463:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:7639:x1873884700752128:12345-0@lo:101: Request processed in 280us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075816.711480:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787075816.711698:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700752128:0@lo:101: 00010000:00010000:1.0:1787075816.711716:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f3bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x859911ad6869f3c2 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.711725:0:7639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f3bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x859911ad6869f3c2 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075816.711868:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f54700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700752256:0@lo:501: 00000100:00100000:1.0:1787075816.711906:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075816.711951:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961866a1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787075816.712065:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700752256 00000100:00100000:3.0:1787075816.712071:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700752256 00000100:00100000:3.0:1787075816.712252:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787075816.712263:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:7639:x1873884700752256:12345-0@lo:501: 00000100:00100000:3.0:1787075816.712684:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:7639:x1873884700752256:12345-0@lo:501: Request processed in 421us (776us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787075816.712692:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787075816.714307:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f54700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700752256:0@lo:501: 10000000:01000000:2.0:1787075816.714353:0:7639:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787075816.714428:0:7639:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787075816.714451:0:7639:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f3bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x859911ad6869f3c2 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.714488:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f3bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x859911ad6869f3c2 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.714496:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f3bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x859911ad6869f3c2 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.714670:0:7639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787075816.714714:0:7639:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9961bf681000 10000000:01000000:2.0:1787075816.714720:0:7639:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787075816.714727:0:7639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787075816.714730:0:7639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787075816.714736:0:7639:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787075816.714739:0:7639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787075816.714778:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad6869f3c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.714787:0:7639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad6869f3c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.714799:0:7639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad6869f3c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075816.714836:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700752384:0@lo:101: 00000100:00100000:2.0:1787075816.714909:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075816.714974:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62e840 going to sleep for 11 seconds 00000100:00100000:3.0:1787075816.715287:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700752384 00000100:00100000:3.0:1787075816.715297:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700752384 00000100:00100000:3.0:1787075816.715363:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787075816.715374:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:7639:x1873884700752384:12345-0@lo:101: 00010000:00010000:3.0:1787075816.715388:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075816.715405:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996183be6c00/0x859911ad6869f3d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f3c9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.715434:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996183be6c00/0x859911ad6869f3d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f3c9 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.715457:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996183be6c00/0x859911ad6869f3d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f3c9 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.715466:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996183be6c00, rc 0) 00000100:00100000:3.0:1787075816.715522:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:7639:x1873884700752384:12345-0@lo:101: Request processed in 149us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075816.715529:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787075816.715835:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700752384:0@lo:101: 00010000:00010000:2.0:1787075816.715851:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad6869f3c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f3d0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.715876:0:7639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad6869f3c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f3d0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075816.716001:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700752512:0@lo:501: 00000100:00100000:2.0:1787075816.716036:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075816.716868:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62e840 going to sleep for 11 seconds 00010000:00010000:1.0:1787075816.717052:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787075816.717064:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f3bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x859911ad6869f3c2 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.717085:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181497600 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787075816.717090:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f3bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x859911ad6869f3c2 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.717100:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f3bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x859911ad6869f3c2 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787075816.717128:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f3bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x859911ad6869f3c2 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075816.717135:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787075816.717173:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f3bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x859911ad6869f3c2 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.717180:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787075816.717337:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f3bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x859911ad6869f3c2 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.717345:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f3bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x859911ad6869f3c2 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.717365:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075816.717367:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075816.717369:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075816.717418:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787075816.717438:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700752640:0@lo:103: 00000100:00100000:2.0:1787075816.717507:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075816.717805:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700752640 00000100:00100000:1.0:1787075816.717815:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700752640 00000100:00100000:1.0:1787075816.717883:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787075816.717893:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:3313:x1873884700752640:12345-0@lo:103: 00010000:00010000:1.0:1787075816.717908:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075816.717926:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996183be6e00/0x859911ad6869f3c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x859911ad6869f3bb expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075816.717952:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075816.717997:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:3313:x1873884700752640:12345-0@lo:103: Request processed in 105us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075816.718004:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787075816.718211:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700752640:0@lo:103: 00000100:00100000:3.0:1787075816.718852:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700752512 00000100:00100000:3.0:1787075816.718862:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700752512 00000100:00100000:3.0:1787075816.718912:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787075816.718921:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:7639:x1873884700752512:12345-0@lo:501: 00000100:00100000:3.0:1787075816.719520:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:7639:x1873884700752512:12345-0@lo:501: Request processed in 598us (3480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075816.719529:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787075816.719869:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700752512:0@lo:501: 00000100:00100000:2.0:1787075816.719959:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700752768:0@lo:503: 00000100:00100000:2.0:1787075816.720015:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075816.720060:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787075816.720181:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700752768 00000100:00100000:0.0:1787075816.720258:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700752768 00000100:00100000:0.0:1787075816.720308:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787075816.720318:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:7639:x1873884700752768:12345-0@lo:503: 00000100:00100000:0.0:1787075816.720520:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:7639:x1873884700752768:12345-0@lo:503: Request processed in 204us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075816.720527:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787075816.720750:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700752768:0@lo:503: 00000040:00080000:2.0:1787075816.721357:0:7639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787075816.721456:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700752896:0@lo:502: 00000100:00100000:2.0:1787075816.721516:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075816.721762:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787075816.723663:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700752896 00000100:00100000:1.0:1787075816.723686:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700752896 00000100:00100000:1.0:1787075816.723827:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787075816.723843:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:7639:x1873884700752896:12345-0@lo:502: 00000100:00100000:1.0:1787075816.724334:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:7639:x1873884700752896:12345-0@lo:502: Request processed in 496us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075816.724343:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787075816.724488:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700752896:0@lo:502: 00000040:00080000:2.0:1787075816.725421:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787075816.725502:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787075816.725539:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787075816.725735:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787075816.725782:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787075816.725817:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787075816.725876:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700753024:0@lo:502: 00000100:00100000:2.0:1787075816.725973:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075816.729347:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787075816.729764:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700753024 00000100:00100000:0.0:1787075816.729777:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700753024 00000100:00100000:0.0:1787075816.729847:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787075816.729857:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:7639:x1873884700753024:12345-0@lo:502: 00000100:00100000:0.0:1787075816.730425:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:7639:x1873884700753024:12345-0@lo:502: Request processed in 569us (4450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075816.730436:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787075816.731037:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700753024:0@lo:502: 00000040:00080000:2.0:1787075816.731421:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787075816.731873:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787075816.733343:0:7646:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787075816.733356:0:7646:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787075816.733365:0:7646:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787075816.733368:0:7646:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787075816.733375:0:7646:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787075816.733415:0:7646:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9961c1800000) 00000020:00000080:1.0:1787075816.733775:0:7646:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787075816.733787:0:7646:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787075816.733867:0:7646:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9961bf681000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787075816.733876:0:7646:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787075816.733885:0:7646:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x859911ad6869f3de 00010000:00010000:3.0:1787075816.751745:0:7646:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787075816.752522:0:7646:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787075816.757984:0:7646:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787075816.758407:0:7646:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787075816.760788:0:7646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787075816.763767:0:7646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787075816.766064:0:7646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787075816.766092:0:7646:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787075816.766101:0:7646:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787075816.766108:0:7646:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787075816.766114:0:7646:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787075816.766119:0:7646:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787075816.766121:0:7646:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787075816.766124:0:7646:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787075816.766126:0:7646:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787075816.766418:0:7646:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787075816.766423:0:7646:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787075816.766425:0:7646:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787075816.766429:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787075816.770206:0:7639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787075816.770257:0:7639:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787075816.771179:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad6869f3c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f3d0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.771207:0:7639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad6869f3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f3d0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787075816.771218:0:7639:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9961bf681000 from 1 10000000:01000000:2.0:1787075816.771222:0:7639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787075816.771275:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad6869f3e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.771285:0:7639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad6869f3e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.771299:0:7639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad6869f3e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075816.771336:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700753152:0@lo:101: 00000100:00100000:2.0:1787075816.771437:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075816.771503:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075816.771597:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700753152 00000100:00100000:0.0:1787075816.771608:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700753152 00000100:00100000:0.0:1787075816.771699:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787075816.771712:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:7639:x1873884700753152:12345-0@lo:101: 00010000:00010000:0.0:1787075816.771730:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075816.771750:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181497400/0x859911ad6869f3ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f3e5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.771785:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181497400/0x859911ad6869f3ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f3e5 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.771798:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181497400/0x859911ad6869f3ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f3e5 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.771809:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181497400, rc 0) 00000100:00100000:0.0:1787075816.771857:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:7639:x1873884700753152:12345-0@lo:101: Request processed in 147us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075816.771865:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787075816.772135:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700753152:0@lo:101: 00010000:00010000:2.0:1787075816.772154:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad6869f3e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f3ec expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.772165:0:7639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad6869f3e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f3ec expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075816.772305:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700753280:0@lo:501: 00000100:00100000:2.0:1787075816.772334:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075816.772365:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075816.772496:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700753280 00000100:00100000:0.0:1787075816.772500:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700753280 00000100:00100000:0.0:1787075816.772532:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787075816.772540:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:7639:x1873884700753280:12345-0@lo:501: 00000100:00100000:0.0:1787075816.774520:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:7639:x1873884700753280:12345-0@lo:501: Request processed in 1967us (2171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075816.774535:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787075816.774711:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700753280:0@lo:501: 00000100:00100000:2.0:1787075816.774780:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700753408:0@lo:503: 00000100:00100000:2.0:1787075816.774837:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075816.774876:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075816.774959:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700753408 00000100:00100000:0.0:1787075816.774966:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700753408 00000100:00100000:0.0:1787075816.775012:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787075816.775022:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:7639:x1873884700753408:12345-0@lo:503: 00000100:00100000:0.0:1787075816.775406:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:7639:x1873884700753408:12345-0@lo:503: Request processed in 385us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075816.775413:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787075816.775703:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700753408:0@lo:503: 00000040:00080000:2.0:1787075816.776067:0:7639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787075816.776163:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700753536:0@lo:502: 00000100:00100000:2.0:1787075816.776230:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075816.776265:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075816.776661:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700753536 00000100:00100000:0.0:1787075816.776669:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700753536 00000100:00100000:0.0:1787075816.776708:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787075816.776717:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:7639:x1873884700753536:12345-0@lo:502: 00000100:00100000:0.0:1787075816.776944:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:7639:x1873884700753536:12345-0@lo:502: Request processed in 227us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075816.776953:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787075816.777162:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700753536:0@lo:502: 00000040:00080000:0.0:1787075816.778091:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787075816.778167:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787075816.778350:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700753664:0@lo:502: 00000100:00100000:0.0:1787075816.778447:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075816.778549:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9c8ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787075816.778952:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700753664 00000100:00100000:3.0:1787075816.778962:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700753664 00000100:00100000:3.0:1787075816.779025:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787075816.779036:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:7639:x1873884700753664:12345-0@lo:502: 00000100:00100000:3.0:1787075816.781115:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:7639:x1873884700753664:12345-0@lo:502: Request processed in 2069us (2656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075816.781133:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787075816.783847:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700753664:0@lo:502: 00000040:00080000:2.0:1787075816.784135:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787075816.784155:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787075816.788953:0:7650:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787075816.788973:0:7650:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787075816.788976:0:7650:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787075816.788983:0:7650:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9961bf681000 00000020:00000080:2.0:1787075816.788986:0:7650:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787075816.789011:0:7650:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787075816.789014:0:7650:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787075816.789016:0:7650:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787075816.789019:0:7650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787075816.792247:0:7639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787075816.792302:0:7639:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787075816.792333:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad6869f3e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f3ec expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.792351:0:7639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad6869f3e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f3ec expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787075816.792434:0:7639:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787075816.792438:0:7639:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9961bf681000 10000000:01000000:3.0:1787075816.792443:0:7639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9961bf681000 10000000:01000000:3.0:1787075816.792450:0:7639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787075816.792458:0:7639:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9961bf681000 from 1 10000000:01000000:3.0:1787075816.792461:0:7639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787075816.792513:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be7600/0x859911ad6869f3f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.792544:0:7639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996183be7600/0x859911ad6869f3f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.792559:0:7639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996183be7600/0x859911ad6869f3f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075816.792877:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700753792:0@lo:101: 00000100:00100000:3.0:1787075816.793004:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075816.793066:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961879983c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787075816.793213:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700753792 00000100:00100000:2.0:1787075816.793222:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700753792 00000100:00100000:2.0:1787075816.793293:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787075816.793305:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:7639:x1873884700753792:12345-0@lo:101: 00010000:00010000:2.0:1787075816.793322:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075816.793340:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181522a00/0x859911ad6869f3fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f3f3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.793372:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181522a00/0x859911ad6869f3fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f3f3 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.793384:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181522a00/0x859911ad6869f3fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f3f3 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.793395:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522a00, rc 0) 00000100:00100000:2.0:1787075816.793454:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:7639:x1873884700753792:12345-0@lo:101: Request processed in 150us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075816.793461:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787075816.793617:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700753792:0@lo:101: 00010000:00010000:0.0:1787075816.793635:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996183be7600/0x859911ad6869f3f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f3fa expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.793678:0:7639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996183be7600/0x859911ad6869f3f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f3fa expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075816.793822:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700753920:0@lo:501: 00000100:00100000:0.0:1787075816.793856:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075816.793887:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9c8cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787075816.796244:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700753920 00000100:00100000:3.0:1787075816.796263:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700753920 00000100:00100000:3.0:1787075816.796346:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787075816.796358:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:7639:x1873884700753920:12345-0@lo:501: 00000100:00100000:3.0:1787075816.797151:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:7639:x1873884700753920:12345-0@lo:501: Request processed in 791us (3288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075816.797162:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787075816.797752:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700753920:0@lo:501: 00000100:00100000:2.0:1787075816.797825:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700754048:0@lo:503: 00000100:00100000:2.0:1787075816.797881:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075816.797926:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787075816.797993:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700754048 00000100:00100000:3.0:1787075816.797999:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700754048 00000100:00100000:3.0:1787075816.798040:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787075816.798047:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:7639:x1873884700754048:12345-0@lo:503: 00000100:00100000:3.0:1787075816.798336:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:7639:x1873884700754048:12345-0@lo:503: Request processed in 288us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075816.798343:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787075816.798482:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700754048:0@lo:503: 00000040:00080000:2.0:1787075816.798882:0:7639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787075816.798971:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700754176:0@lo:502: 00000100:00100000:2.0:1787075816.799016:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075816.799044:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787075816.799368:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700754176 00000100:00100000:3.0:1787075816.799376:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700754176 00000100:00100000:3.0:1787075816.799422:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787075816.799432:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:7639:x1873884700754176:12345-0@lo:502: 00000100:00100000:3.0:1787075816.799924:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:7639:x1873884700754176:12345-0@lo:502: Request processed in 492us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075816.799946:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787075816.800007:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700754176:0@lo:502: 00000040:00080000:3.0:1787075816.803418:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787075816.803540:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787075816.804398:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787075816.804482:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787075816.804518:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787075816.805864:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787075816.805999:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787075816.806038:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787075816.807301:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787075816.807399:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787075816.807436:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787075816.807485:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787075816.807521:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787075816.807558:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787075816.811366:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787075816.811437:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787075816.811474:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787075816.811521:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787075816.811558:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787075816.811874:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787075816.811922:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787075816.811969:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787075816.811999:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787075816.812043:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787075816.812156:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787075816.812269:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787075816.812323:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787075816.812361:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787075816.812396:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787075816.812444:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787075816.812481:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787075816.812514:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787075816.812545:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787075816.812978:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787075816.813021:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787075816.813072:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787075816.813963:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787075816.814036:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700754304:0@lo:502: 00000100:00100000:2.0:1787075816.814174:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075816.814248:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62e240 going to sleep for 11 seconds 00000100:00100000:3.0:1787075816.814403:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700754304 00000100:00100000:3.0:1787075816.814414:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700754304 00000100:00100000:3.0:1787075816.814486:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787075816.814498:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:7639:x1873884700754304:12345-0@lo:502: 00000100:00100000:3.0:1787075816.814865:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:7639:x1873884700754304:12345-0@lo:502: Request processed in 367us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075816.814875:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787075816.815087:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700754304:0@lo:502: 00000040:00080000:0.0:1787075816.815200:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787075816.815220:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787075816.816335:0:7651:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787075816.816359:0:7651:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9961b9e00000) 00000020:00000080:0.0:1787075816.816389:0:7651:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787075816.816766:0:7651:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9961bf681000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787075816.816772:0:7651:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9961bf681000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787075816.816775:0:7651:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9961bf681000 3 00010000:00080000:0.0:1787075816.816814:0:7651:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9961c1999800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.150@tcp at head 00010000:00010000:0.0:1787075816.818798:0:7651:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787075816.818970:0:7651:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787075816.819019:0:7651:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787075816.819048:0:7651:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x859911ad6869f408 00000100:00080000:0.0:1787075816.819060:0:7651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787075816.819067:0:7651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9961c1999800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:0.0:1787075816.821823:0:7651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9961b9df8380 x1873884700754432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787075816.821918:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1873884700754432:0@lo:38: 00000100:00100000:3.0:1787075816.822039:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075816.822219:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700754432 00000100:00100000:2.0:1787075816.822229:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700754432 00000100:00100000:2.0:1787075816.822285:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787075816.822294:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1873884700754432:12345-0@lo:38: 00010000:00080000:2.0:1787075816.822329:0:5854:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:2.0:1787075816.822372:0:5854:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x859911ad6869f40f 00000004:00100000:2.0:1787075816.822390:0:5854:0:(mdt_handler.c:7351:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787075816.822429:0:5854:0:(import.c:65:import_set_state_nolock()) ffff9961b4e19000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787075816.823313:0:7651:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1787075816.825292:0:7651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:0.0:1787075816.825673:0:7653:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9961b9dfa680 x1873884700754560/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075816.825687:0:7653:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9c8c840 going to sleep for 0 seconds 00000100:00100000:0.0:1787075816.826010:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787075816.826031:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700754944:0@lo:400: 00000100:00100000:1.0:1787075816.826502:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700754688:0@lo:400: 00000100:00100000:1.0:1787075816.826584:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075816.826633:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787075816.826660:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700754816:0@lo:400: 00000100:00100000:1.0:1787075816.826684:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075816.826720:0:5852:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787075816.826729:0:5852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787075816.826942:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075816.829757:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700754944 00000100:00100000:1.0:1787075816.829775:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700754944 00000100:00100000:1.0:1787075816.829871:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787075816.829883:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700754944:12345-0@lo:400: 00000100:00100000:1.0:1787075816.830035:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700754944:12345-0@lo:400: Request processed in 154us (3092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075816.830046:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787075816.830139:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9df8e00 x1873884700754944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075816.830159:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700754944:0@lo:400: 00000100:00100000:2.0:1787075816.830447:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873884700754432:12345-0@lo:38: Request processed in 8151us (8406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075816.830459:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787075816.830481:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787075816.830498:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700754688 00000100:00100000:2.0:1787075816.830503:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700754688 00000100:00100000:2.0:1787075816.830528:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700754816 00000100:00100000:2.0:1787075816.830531:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700754816 00000100:00080000:2.0:1787075816.830548:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787075816.830577:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787075816.830585:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700754688:12345-0@lo:400: 00000100:00100000:2.0:1787075816.830655:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700754688:12345-0@lo:400: Request processed in 54us (4055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075816.830662:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787075816.830673:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787075816.830680:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700754816:12345-0@lo:400: 00000100:00100000:2.0:1787075816.830720:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700754816:12345-0@lo:400: Request processed in 42us (4035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075816.830727:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787075816.831703:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9dfb480 x1873884700754816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075816.831719:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700754816:0@lo:400: 00010000:00080000:1.0:1787075816.831733:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9df9500 x1873884700754688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075816.831742:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700754688:0@lo:400: 00010000:00080000:3.0:1787075816.831847:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9df8380 x1873884700754432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787075826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075816.831867:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787075816.831878:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787075816.831889:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787075816.831895:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787075816.831899:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961c1999800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787075816.831908:0:3310:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e1bb4f17): req@ffff9961b9dfa680 x1873884700754560/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075816.831945:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1873884700754432:0@lo:38: 00000020:01000000:3.0:1787075816.831988:0:7639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787075816.832031:0:7639:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787075816.832049:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be7600/0x859911ad6869f3f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f3fa expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075816.832061:0:7639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996183be7600/0x859911ad6869f3f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f3fa expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787075816.832142:0:7639:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787075816.832145:0:7639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787075816.832147:0:7639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787075816.832148:0:7639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787075816.832149:0:7639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787075816.832152:0:7639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787075816.832153:0:7639:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787075816.832155:0:7639:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787075816.832157:0:7639:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787075816.832159:0:7639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787075816.832161:0:7639:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787075816.832166:0:7639:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787075816.832169:0:7639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787075816.832171:0:7639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787075816.832176:0:7639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787075816.832177:0:7639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787075816.832178:0:7639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787075816.832179:0:7639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:1.0:1787075816.832397:0:7653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075816.832435:0:7653:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9c8c840 going to sleep for 11 seconds 00000020:01000004:3.0:1787075816.832693:0:7639:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787075816.832694:0:7639:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787075816.832695:0:7639:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787075816.832696:0:7639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787075816.832697:0:7639:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787075816.832724:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700754560 00000100:00100000:3.0:1787075816.832731:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700754560 00000100:00100000:3.0:1787075816.832793:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787075816.832816:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7653:x1873884700754560:12345-0@lo:901: 00000100:00080000:1.0:1787075816.833193:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075816.834003:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7653:x1873884700754560:12345-0@lo:901: Request processed in 1199us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075816.834015:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787075816.834593:0:7653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b9dfa680 x1873884700754560/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787075832 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075816.834611:0:7653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfa680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7653:1873884700754560:0@lo:901: 10000000:01000000:2.0:1787075816.835271:0:7639:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787075816.835299:0:7639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700755072:0@lo:253: 00000100:00100000:2.0:1787075816.835367:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075816.835410:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700755072 00000100:00100000:2.0:1787075816.835418:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700755072 00000100:00100000:2.0:1787075816.835488:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787075816.835499:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:7639:x1873884700755072:12345-0@lo:253: 20000000:01000000:2.0:1787075816.835745:0:5846:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787075816.835766:0:5846:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787075816.837499:0:7639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62ef00 going to sleep for 11 seconds 20000000:01000000:2.0:1787075816.910734:0:5846:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787075816.910760:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787075816.911531:0:5868:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787075816.911539:0:5868:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787075816.911686:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996181497600/0x859911ad6869f416 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.911713:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181522000/0x859911ad6869f367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f360 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.911723:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996181497600/0x859911ad6869f416 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.911781:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181522000/0x859911ad6869f367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f360 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.911800:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996181522000/0x859911ad6869f367 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f360 expref: 14 pid: 5846 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075816.911820:0:5868:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1873884700755200:0@lo:104: 00000100:00100000:0.0:1787075816.911917:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075816.912054:0:5868:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9c8cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787075816.919420:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700755200 00000100:00100000:2.0:1787075816.919451:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700755200 00000100:00100000:2.0:1787075816.921894:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787075816.921911:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:5868:x1873884700755200:12345-0@lo:104: 00010000:00010000:2.0:1787075816.921950:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996183be6a00/0x859911ad6869f360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f367 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.922105:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787075816.922113:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:5868:x1873884700755200:12345-0@lo:104: Request processed in 205us (10196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075816.922121:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787075816.922150:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787075816.922157:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996183be6a00/0x859911ad6869f360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f367 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.922196:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996183be6a00 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:2.0:1787075816.922201:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996183be6a00/0x859911ad6869f360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f367 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.922210:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996183be6a00/0x859911ad6869f360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f367 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787075816.922218:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996183be6a00/0x859911ad6869f360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f367 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787075816.922223:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787075816.922275:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996183be6a00/0x859911ad6869f360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f367 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.922283:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787075816.922306:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996183be6a00/0x859911ad6869f360 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f367 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.922313:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996183be6a00/0x859911ad6869f360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f367 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.922338:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075816.922340:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075816.922342:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075816.922383:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700755328:0@lo:103: 00000100:00100000:2.0:1787075816.922442:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075816.922967:0:5868:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1873884700755200:0@lo:104: 00010000:00010000:0.0:1787075816.922998:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996181497600/0x859911ad6869f416 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075816.923025:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700755328 00000100:00100000:0.0:1787075816.923033:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700755328 00010000:00010000:0.0:1787075816.923061:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181522000/0x859911ad6869f367 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f360 expref: 15 pid: 5846 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075816.923467:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787075816.923477:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a03c8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:3314:x1873884700755328:12345-0@lo:103: 00010000:00010000:0.0:1787075816.923493:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075816.923499:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181522000/0x859911ad6869f367 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f360 expref: 15 pid: 5846 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.923511:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181522000/0x859911ad6869f367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f360 expref: 15 pid: 5846 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.923530:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181522000/0x859911ad6869f367 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f360 expref: 15 pid: 5846 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.923549:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996181497600/0x859911ad6869f416 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.923569:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181497600/0x859911ad6869f416 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787075816.923591:0:5838:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012052053s 00010000:00010000:0.0:1787075816.923596:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996181497600/0x859911ad6869f416 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.923605:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996181497600/0x859911ad6869f416 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.923612:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996181497600/0x859911ad6869f416 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.923620:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996181497600/0x859911ad6869f416 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.923632:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181497600 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787075816.923673:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996181497600/0x859911ad6869f416 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.923684:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996181497600/0x859911ad6869f416 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.923699:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996181497600/0x859911ad6869f416 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075816.923711:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075816.923775:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a03c8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:3314:x1873884700755328:12345-0@lo:103: Request processed in 299us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075816.923783:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787075816.923882:0:5868:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996181497600/0x859911ad6869f416 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.923902:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996181497600/0x859911ad6869f416 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075816.923910:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181497600/0x859911ad6869f416 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075816.924055:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700755328:0@lo:103: 00000100:00100000:2.0:1787075816.949512:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:7639:x1873884700755072:12345-0@lo:253: Request processed in 113995us (114126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075816.949534:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787075816.949820:0:7639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7639:1873884700755072:0@lo:253: 10000000:01000000:3.0:1787075816.949840:0:7639:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787075816.949844:0:7639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787075816.949846:0:7639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787075816.949848:0:7639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787075816.949849:0:7639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787075816.949851:0:7639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787075816.949852:0:7639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787075816.949853:0:7639:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787075816.949855:0:7639:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787075816.949857:0:7639:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787075816.949859:0:7639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787075816.949861:0:7639:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787075816.949887:0:7639:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787075816.956997:0:7639:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787075816.957359:0:7639:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787075816.957794:0:7639:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787075816.958001:0:7639:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787075816.958442:0:7639:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787075816.962544:0:7639:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787075816.973758:0:7639:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1787075817.360107:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787075817.389673:0:7639:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787075817.389690:0:7639:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787075817.389769:0:7639:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787075817.389858:0:7639:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.150@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787075817.389878:0:7639:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787075817.389927:0:7639:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787075818.377895:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075819.214958:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700755456:0@lo:13: 00000100:00100000:1.0:1787075819.215066:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075819.223200:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700755456 00000100:00100000:1.0:1787075819.223221:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700755456 00000100:00100000:1.0:1787075819.223317:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787075819.223330:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700755456:12345-0@lo:13: 00002000:00000024:1.0:1787075819.223390:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787075819.223876:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787075819.225214:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700755456:12345-0@lo:13: Request processed in 1877us (10137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075819.225231:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787075819.225310:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b00fe300 x1873884700755456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075835 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075819.225341:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700755456:0@lo:13: 00010000:00010000:0.0:1787075819.402097:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787075820.425101:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075821.451043:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075822.280556:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700755712:0@lo:400: 00000100:00100000:1.0:1787075822.280665:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700755584:0@lo:400: 00000100:00100000:2.0:1787075822.280713:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075822.280731:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075822.280806:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700755968:0@lo:400: 00000100:00100000:2.0:1787075822.281222:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787075822.281230:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700755840:0@lo:400: 00000100:00100000:1.0:1787075822.287143:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700756096:0@lo:400: 00000100:00100000:1.0:1787075822.287254:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075822.288079:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700755712 00000100:00100000:1.0:1787075822.288099:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700755712 00000100:00100000:1.0:1787075822.288176:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700756096 00000100:00100000:1.0:1787075822.288180:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700756096 00000100:00100000:0.0:1787075822.288197:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075822.288245:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787075822.288253:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075822.288264:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700755712:12345-0@lo:400: 00000100:00100000:0.0:1787075822.288283:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700755968 00000100:00100000:0.0:1787075822.288289:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700755968 00000100:00100000:0.0:1787075822.288332:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787075822.288340:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700755968:12345-0@lo:400: 00000100:00100000:0.0:1787075822.288408:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700755968:12345-0@lo:400: Request processed in 68us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075822.288415:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787075822.288448:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787075822.288490:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b00fd180 x1873884700755968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075822.288518:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700755968:0@lo:400: 00000100:00100000:0.0:1787075822.288608:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787075822.288617:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700756096:12345-0@lo:400: 00000100:00100000:1.0:1787075822.288628:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700755584 00000100:00100000:1.0:1787075822.288634:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700755584 00000100:00100000:1.0:1787075822.288703:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787075822.288704:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700756096:12345-0@lo:400: Request processed in 87us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075822.288714:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787075822.288718:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:3312:x1873884700755584:12345-0@lo:400: 00000100:00100000:0.0:1787075822.288761:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700755712:12345-0@lo:400: Request processed in 502us (8050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075822.288767:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787075822.288778:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:3312:x1873884700755584:12345-0@lo:400: Request processed in 64us (8045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075822.288787:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787075822.288799:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700755584:0@lo:400: 00010000:00080000:0.0:1787075822.288821:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b00fdf80 x1873884700756096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075822.288845:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700756096:0@lo:400: 00000100:00100000:2.0:1787075822.294624:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787075822.295087:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b00fe300 x1873884700755712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787075822.295117:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700755712:0@lo:400: 00000100:00100000:0.0:1787075822.301532:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700755840 00000100:00100000:0.0:1787075822.301557:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700755840 00000100:00100000:0.0:1787075822.302245:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787075822.302275:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700755840:12345-0@lo:400: 00000100:00100000:0.0:1787075822.302420:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700755840:12345-0@lo:400: Request processed in 163us (7813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075822.302438:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787075822.302506:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b00fed80 x1873884700755840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075822.302527:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700755840:0@lo:400: 00000100:00080000:1.0:1787075822.318298:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787075822.472744:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787075822.793654:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787075822.793665:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9961c14da000 from 30 10000000:01000000:2.0:1787075822.793674:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787075822.793754:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522800/0x859911ad6869f41d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.793770:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996181522800/0x859911ad6869f41d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.793785:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181522800/0x859911ad6869f41d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075822.793829:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700756224:0@lo:101: 00000100:00100000:2.0:1787075822.793925:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075822.794755:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616780 going to sleep for 11 seconds 00000100:00100000:2.0:1787075822.794786:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700756224 00000100:00100000:2.0:1787075822.794796:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700756224 00000100:00100000:2.0:1787075822.794882:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787075822.794893:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:5849:x1873884700756224:12345-0@lo:101: 00010000:00010000:2.0:1787075822.794912:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075822.794933:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181523600/0x859911ad6869f424 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f41d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.795664:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181523600/0x859911ad6869f424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f41d expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.795682:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181523600/0x859911ad6869f424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f41d expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.795694:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523600, rc 0) 00000100:00100000:2.0:1787075822.795781:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:5849:x1873884700756224:12345-0@lo:101: Request processed in 889us (1855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075822.795790:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787075822.796089:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700756224:0@lo:101: 00010000:00010000:3.0:1787075822.798066:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181522800/0x859911ad6869f41d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f424 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075822.798093:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181522800/0x859911ad6869f41d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f424 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075822.798202:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700756352:0@lo:501: 00000100:00100000:3.0:1787075822.798290:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075822.798343:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618771c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787075822.799320:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700756352 00000100:00100000:1.0:1787075822.799336:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700756352 00000100:00100000:1.0:1787075822.799399:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787075822.801742:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:5849:x1873884700756352:12345-0@lo:501: 00000100:00100000:1.0:1787075822.802265:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:5849:x1873884700756352:12345-0@lo:501: Request processed in 535us (3972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075822.802712:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700756352:0@lo:501: 00000100:00100000:3.0:1787075822.802783:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700756480:0@lo:503: 00000100:00100000:3.0:1787075822.802859:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075822.802902:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618771c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787075822.802921:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700756480 00000100:00100000:3.0:1787075822.802928:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700756480 00000100:00100000:3.0:1787075822.802974:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787075822.802981:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700756480:12345-0@lo:503: 00000100:00100000:3.0:1787075822.803321:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700756480:12345-0@lo:503: Request processed in 339us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075822.803330:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787075822.803396:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700756480:0@lo:503: 00000100:00100000:1.0:1787075822.803979:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787075822.814310:0:7827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7827:1873884700756608:0@lo:502: 00000100:00100000:0.0:1787075822.814447:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075822.814622:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700756608 00000100:00100000:3.0:1787075822.814634:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700756608 00000100:00100000:3.0:1787075822.814713:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787075822.814724:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:7827:x1873884700756608:12345-0@lo:502: 00000100:00100000:3.0:1787075822.821449:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:7827:x1873884700756608:12345-0@lo:502: Request processed in 6712us (6988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075822.821568:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787075822.821863:0:7827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9c8c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787075822.821905:0:7827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7827:1873884700756608:0@lo:502: 00000100:00100000:0.0:1787075822.822017:0:7827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7827:1873884700756736:0@lo:502: 00000100:00100000:0.0:1787075822.822083:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075822.822240:0:7827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961866a1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787075822.828675:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700756736 00000100:00100000:2.0:1787075822.828699:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700756736 00000100:00100000:2.0:1787075822.828772:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787075822.828785:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:7827:x1873884700756736:12345-0@lo:502: 00000100:00100000:2.0:1787075822.829358:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:7827:x1873884700756736:12345-0@lo:502: Request processed in 573us (7273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075822.829368:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787075822.829637:0:7827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7827:1873884700756736:0@lo:502: 00000040:00080000:1.0:1787075822.829706:0:7827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787075822.829935:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787075822.829970:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787075822.829984:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522800/0x859911ad6869f41d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f424 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075822.829998:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181522800/0x859911ad6869f41d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f424 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787075822.830010:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787075822.830013:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787075822.830016:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787075822.830056:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be7400/0x859911ad6869f42b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075822.830065:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996183be7400/0x859911ad6869f42b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075822.830077:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996183be7400/0x859911ad6869f42b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075822.830101:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700756864:0@lo:101: 00000100:00100000:3.0:1787075822.830158:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075822.830205:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618771cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787075822.830312:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700756864 00000100:00100000:2.0:1787075822.830319:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700756864 00000100:00100000:2.0:1787075822.830357:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787075822.830365:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:5849:x1873884700756864:12345-0@lo:101: 00010000:00010000:2.0:1787075822.830377:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075822.830394:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181522000/0x859911ad6869f432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f42b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.830432:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181522000/0x859911ad6869f432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f42b expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.830445:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181522000/0x859911ad6869f432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f42b expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.830455:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522000, rc 0) 00000100:00100000:2.0:1787075822.830504:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700756864:12345-0@lo:101: Request processed in 139us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075822.830511:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787075822.830539:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700756864:0@lo:101: 00010000:00010000:2.0:1787075822.830552:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996183be7400/0x859911ad6869f42b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f432 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.830573:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996183be7400/0x859911ad6869f42b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f432 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075822.830628:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700756992:0@lo:501: 00000100:00100000:2.0:1787075822.830698:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075822.830715:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616300 going to sleep for 11 seconds 00000100:00100000:2.0:1787075822.830750:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700756992 00000100:00100000:2.0:1787075822.830754:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700756992 00000100:00100000:2.0:1787075822.830770:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787075822.830776:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700756992:12345-0@lo:501: 00000100:00100000:2.0:1787075822.831382:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700756992:12345-0@lo:501: Request processed in 603us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075822.831391:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787075822.831548:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700756992:0@lo:501: 00000100:00100000:2.0:1787075822.831584:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700757120:0@lo:503: 00000100:00100000:2.0:1787075822.831628:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075822.831790:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616300 going to sleep for 11 seconds 00000100:00100000:2.0:1787075822.831804:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700757120 00000100:00100000:2.0:1787075822.831808:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700757120 00000100:00100000:2.0:1787075822.831843:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787075822.831850:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700757120:12345-0@lo:503: 00000100:00100000:2.0:1787075822.832686:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700757120:12345-0@lo:503: Request processed in 834us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075822.832696:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787075822.832908:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700757120:0@lo:503: 00000100:00100000:3.0:1787075822.834490:0:7831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7831:1873884700757248:0@lo:502: 00000100:00100000:3.0:1787075822.834601:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075822.834726:0:7831:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618771c900 going to sleep for 11 seconds 00000100:00100000:0.0:1787075822.836580:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700757248 00000100:00100000:0.0:1787075822.836598:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700757248 00000100:00100000:0.0:1787075822.836690:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787075822.836702:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:7831:x1873884700757248:12345-0@lo:502: 00000100:00100000:1.0:1787075822.839613:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:7831:x1873884700757248:12345-0@lo:502: Request processed in 2900us (5001us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075822.839632:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787075822.839746:0:7831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7831:1873884700757248:0@lo:502: 00000020:01000000:2.0:1787075822.839809:0:7831:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787075822.839834:0:7831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787075822.839837:0:7831:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787075822.839844:0:7831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787075822.839847:0:7831:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787075822.840627:0:7831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7831:1873884700757376:0@lo:502: 00000100:00100000:2.0:1787075822.840733:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075822.840781:0:7831:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616300 going to sleep for 11 seconds 00000100:00100000:1.0:1787075822.841575:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700757376 00000100:00100000:1.0:1787075822.841586:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700757376 00000100:00100000:1.0:1787075822.841667:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787075822.841677:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:7831:x1873884700757376:12345-0@lo:502: 00000100:00100000:1.0:1787075822.842861:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:7831:x1873884700757376:12345-0@lo:502: Request processed in 1177us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075822.842875:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787075822.850167:0:7831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7831:1873884700757376:0@lo:502: 00000020:01000000:2.0:1787075822.850234:0:7831:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787075822.850246:0:7831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787075822.850249:0:7831:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787075822.850255:0:7831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787075822.870240:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787075822.870300:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787075822.870317:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be7400/0x859911ad6869f42b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f432 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075822.870334:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996183be7400/0x859911ad6869f42b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f432 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787075822.872609:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787075822.872621:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9961a03a5800 from 30 10000000:01000000:0.0:1787075822.872629:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787075822.872710:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181497800/0x859911ad6869f439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075822.872724:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996181497800/0x859911ad6869f439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075822.872751:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181497800/0x859911ad6869f439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075822.872785:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700757504:0@lo:101: 00000100:00100000:0.0:1787075822.872893:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075822.872968:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9c8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787075822.873151:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700757504 00000100:00100000:3.0:1787075822.873162:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700757504 00000100:00100000:3.0:1787075822.873236:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787075822.873249:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700757504:12345-0@lo:101: 00010000:00010000:3.0:1787075822.873266:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075822.873283:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996183be6400/0x859911ad6869f440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f439 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075822.873314:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996183be6400/0x859911ad6869f440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f439 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075822.873328:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996183be6400/0x859911ad6869f440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f439 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075822.873338:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996183be6400, rc 0) 00000100:00100000:3.0:1787075822.873390:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:5849:x1873884700757504:12345-0@lo:101: Request processed in 144us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075822.873412:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787075822.873707:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700757504:0@lo:101: 00010000:00010000:0.0:1787075822.873727:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181497800/0x859911ad6869f439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f440 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075822.873737:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181497800/0x859911ad6869f439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f440 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075822.873801:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700757632:0@lo:501: 00000100:00100000:0.0:1787075822.873843:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075822.873871:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9c8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787075822.875106:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700757632 00000100:00100000:3.0:1787075822.875120:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700757632 00000100:00100000:3.0:1787075822.875171:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787075822.875180:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:5849:x1873884700757632:12345-0@lo:501: 00000100:00100000:3.0:1787075822.877134:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:5849:x1873884700757632:12345-0@lo:501: Request processed in 1944us (3279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075822.877161:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787075822.877620:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700757632:0@lo:501: 00000100:00100000:0.0:1787075822.877719:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700757760:0@lo:503: 00000100:00100000:0.0:1787075822.877788:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075822.877835:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700757760 00000100:00100000:0.0:1787075822.877842:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700757760 00000100:00100000:0.0:1787075822.877887:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787075822.877896:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:5849:x1873884700757760:12345-0@lo:503: 00000100:00100000:1.0:1787075822.878728:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9c8c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787075822.879290:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:5849:x1873884700757760:12345-0@lo:503: Request processed in 1390us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075822.879312:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787075822.879665:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700757760:0@lo:503: 00000100:00100000:0.0:1787075822.882251:0:7834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7834:1873884700757888:0@lo:502: 00000100:00100000:0.0:1787075822.882366:0:7834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075822.882444:0:7834:0:(client.c:2702:ptlrpc_set_wait()) set ffff996185fc1240 going to sleep for 11 seconds 00000100:00100000:1.0:1787075822.883616:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700757888 00000100:00100000:1.0:1787075822.883633:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700757888 00000100:00100000:1.0:1787075822.883772:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787075822.883785:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:7834:x1873884700757888:12345-0@lo:502: 00000100:00100000:1.0:1787075822.885447:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:7834:x1873884700757888:12345-0@lo:502: Request processed in 1643us (3060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075822.885704:0:7834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7834:1873884700757888:0@lo:502: 00000100:00100000:0.0:1787075822.885804:0:7834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7834:1873884700758016:0@lo:502: 00000100:00100000:0.0:1787075822.885873:0:7834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075822.885909:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700758016 00000100:00100000:0.0:1787075822.885916:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700758016 00000100:00100000:3.0:1787075822.886597:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787075822.886613:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:7834:x1873884700758016:12345-0@lo:502: 00000100:00100000:3.0:1787075822.886907:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:7834:x1873884700758016:12345-0@lo:502: Request processed in 300us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075822.886915:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787075822.887901:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787075822.888678:0:7834:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961879df6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075822.888730:0:7834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7834:1873884700758016:0@lo:502: 00000040:00080000:0.0:1787075822.888776:0:7834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787075822.889227:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787075822.889255:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787075822.889268:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181497800/0x859911ad6869f439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f440 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.889281:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181497800/0x859911ad6869f439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f440 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787075822.889293:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787075822.889296:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9961a03a5800 from 5 10000000:01000000:2.0:1787075822.889299:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787075822.889348:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad6869f447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.889356:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad6869f447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.889382:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad6869f447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075822.891131:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700758144:0@lo:101: 00000100:00100000:2.0:1787075822.891277:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075822.891334:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787075822.891569:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700758144 00000100:00100000:3.0:1787075822.891580:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700758144 00000100:00100000:3.0:1787075822.891687:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787075822.891700:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:5849:x1873884700758144:12345-0@lo:101: 00010000:00010000:3.0:1787075822.891723:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075822.891750:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996183be6200/0x859911ad6869f44e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f447 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075822.891785:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996183be6200/0x859911ad6869f44e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f447 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075822.891797:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996183be6200/0x859911ad6869f44e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f447 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075822.891808:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996183be6200, rc 0) 00000100:00100000:3.0:1787075822.891873:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700758144:12345-0@lo:101: Request processed in 175us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075822.891880:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787075822.893831:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700758144:0@lo:101: 00010000:00010000:2.0:1787075822.893870:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad6869f447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f44e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.895767:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad6869f447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f44e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075822.895921:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700758272:0@lo:256: 00000100:00100000:2.0:1787075822.896085:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075822.896146:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787075822.896262:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700758272 00000100:00100000:0.0:1787075822.896271:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700758272 00000100:00100000:0.0:1787075822.896333:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787075822.896343:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700758272:12345-0@lo:256: 20000000:01000000:0.0:1787075822.896369:0:5847:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787075822.896392:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787075822.896395:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787075822.896663:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700758272:12345-0@lo:256: Request processed in 299us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075822.896672:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787075822.897337:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700758272:0@lo:256: 10000000:01000000:2.0:1787075822.897408:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787075822.897435:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad6869f447 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f44e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.897447:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad6869f447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f44e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787075822.897458:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787075822.897461:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787075822.897629:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787075822.897692:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.897702:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.897714:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075822.897733:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700758400:0@lo:101: 00000100:00100000:2.0:1787075822.897783:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075822.897834:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787075822.899002:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700758400 00000100:00100000:1.0:1787075822.899016:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700758400 00000100:00100000:1.0:1787075822.899080:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787075822.899092:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700758400:12345-0@lo:101: 00010000:00010000:1.0:1787075822.899110:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075822.899130:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996190039600/0x859911ad6869f45c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f455 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075822.899162:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996190039600/0x859911ad6869f45c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f455 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075822.899174:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996190039600/0x859911ad6869f45c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f455 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075822.899184:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190039600, rc 0) 00000100:00100000:1.0:1787075822.899259:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700758400:12345-0@lo:101: Request processed in 170us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075822.899266:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787075822.899621:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700758400:0@lo:101: 00010000:00010000:2.0:1787075822.899824:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f45c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.899838:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f45c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075822.899923:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700758528:0@lo:501: 00000100:00100000:2.0:1787075822.899973:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075822.900016:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787075822.900168:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700758528 00000100:00100000:0.0:1787075822.900175:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700758528 00000100:00100000:0.0:1787075822.900219:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787075822.900228:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700758528:12345-0@lo:501: 00000100:00100000:0.0:1787075822.900576:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700758528:12345-0@lo:501: Request processed in 349us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075822.900585:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787075822.902554:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700758528:0@lo:501: 00000100:00100000:2.0:1787075822.902683:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700758656:0@lo:503: 00000100:00100000:2.0:1787075822.902789:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075822.902850:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787075822.903110:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700758656 00000100:00100000:1.0:1787075822.903120:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700758656 00000100:00100000:1.0:1787075822.903188:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787075822.903201:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191063850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700758656:12345-0@lo:503: 00000100:00100000:1.0:1787075822.903719:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191063850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700758656:12345-0@lo:503: Request processed in 519us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075822.903730:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787075822.904974:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700758656:0@lo:503: 00000100:00100000:0.0:1787075822.906165:0:7835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7835:1873884700758784:0@lo:502: 00000100:00100000:0.0:1787075822.906268:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075822.906321:0:7835:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961879df840 going to sleep for 11 seconds 00000100:00100000:2.0:1787075822.906609:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700758784 00000100:00100000:2.0:1787075822.906618:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700758784 00000100:00100000:2.0:1787075822.906704:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787075822.906715:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:7835:x1873884700758784:12345-0@lo:502: 00000100:00100000:2.0:1787075822.908457:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:7835:x1873884700758784:12345-0@lo:502: Request processed in 1731us (2176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075822.908483:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787075822.909949:0:7835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7835:1873884700758784:0@lo:502: 00000020:01000000:1.0:1787075822.910033:0:7835:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787075822.910043:0:7835:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787075822.910054:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787075822.910057:0:7835:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787075822.910063:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787075822.910068:0:7835:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.150@tcp to nid 0x20000c0a8cc96 (192.168.204.150@tcp) 00000020:01000000:1.0:1787075822.910098:0:7835:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787075822.910102:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787075822.910125:0:7835:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9961c1804d40) 00000020:00000080:1.0:1787075822.910156:0:7835:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787075822.910163:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787075822.910272:0:7835:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787075822.910289:0:7835:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787075822.910299:0:7835:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x859911ad6869f46a 00010000:00080000:1.0:1787075822.910336:0:7835:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9961c180b000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.150@tcp at head 00010000:00010000:1.0:1787075822.910678:0:7835:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1787075822.911099:0:7835:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787075822.911116:0:7835:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787075822.911767:0:7835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787075822.912009:0:7835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787075822.912071:0:7835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787075822.912141:0:7835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787075822.913540:0:7836:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787075822.913548:0:7836:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787075822.916268:0:7835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787075822.916291:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787075822.916343:0:7835:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787075822.916379:0:7835:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x859911ad6869f471 00000100:00080000:0.0:1787075822.916393:0:7835:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787075822.916401:0:7835:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9961c180b000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:0.0:1787075822.917070:0:7835:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9961b9df8e00 x1873884700758912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787075822.917153:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700758912:0@lo:8: 00000100:00100000:3.0:1787075822.917287:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787075822.917367:0:7835:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787075822.917588:0:7835:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787075822.917595:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787075822.917597:0:7835:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787075822.917602:0:7835:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787075822.917608:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787075822.917609:0:7835:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787075822.917613:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787075822.917615:0:7835:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787075822.917669:0:7835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7835:1873884700759040:0@lo:502: 00000100:00100000:0.0:1787075822.917725:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075822.917799:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700758912 00000100:00100000:1.0:1787075822.917809:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700758912 00000100:00100000:1.0:1787075822.917866:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787075822.917876:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1873884700758912:12345-0@lo:8: 00010000:00080000:1.0:1787075822.917909:0:6706:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:1.0:1787075822.917948:0:6706:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x859911ad6869f478 00002000:00100000:1.0:1787075822.917978:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9961bf061000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113901 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787075822.917993:0:6706:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1787075822.917998:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787075822.918161:0:6706:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787075822.918347:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787075822.918384:0:6706:0:(import.c:65:import_set_state_nolock()) ffff9961bf061800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787075822.920310:0:7835:0:(client.c:2702:ptlrpc_set_wait()) set ffff996185fc1600 going to sleep for 11 seconds 00000100:00100000:2.0:1787075822.921690:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700759040 00000100:00100000:2.0:1787075822.921709:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700759040 00000100:00100000:2.0:1787075822.921786:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787075822.921798:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:7835:x1873884700759040:12345-0@lo:502: 00000100:00100000:1.0:1787075822.922380:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1873884700758912:12345-0@lo:8: Request processed in 4500us (5089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075822.922394:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787075822.922834:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:7835:x1873884700759040:12345-0@lo:502: Request processed in 1036us (5106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075822.922843:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787075822.923401:0:7835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:7835:1873884700759040:0@lo:502: 00000020:01000000:0.0:1787075822.923626:0:7835:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787075822.923669:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787075822.923672:0:7835:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787075822.923683:0:7835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1787075822.923778:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787075822.923806:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787075822.923832:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f455 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f45c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.923848:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f45c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787075822.923861:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787075822.923865:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9961b009b380 from 1 10000000:01000000:2.0:1787075822.923868:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787075822.924002:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f47f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.924023:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f47f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.924097:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f47f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075822.924125:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700759168:0@lo:101: 00000100:00100000:2.0:1787075822.924365:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075822.924405:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700759168 00000100:00100000:2.0:1787075822.924411:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700759168 00000100:00100000:2.0:1787075822.924457:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787075822.924468:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700759168:12345-0@lo:101: 00010000:00010000:2.0:1787075822.924482:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075822.924498:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181523400/0x859911ad6869f486 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f47f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.924530:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181523400/0x859911ad6869f486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f47f expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.924554:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181523400/0x859911ad6869f486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f47f expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.924564:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523400, rc 0) 00000100:00100000:2.0:1787075822.924595:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700759168:12345-0@lo:101: Request processed in 129us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075822.924603:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787075822.924757:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961894a1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787075822.924776:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700759168:0@lo:101: 00010000:00010000:2.0:1787075822.924801:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f47f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f486 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.924822:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f47f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f486 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075822.924879:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700759296:0@lo:501: 00000100:00100000:2.0:1787075822.925123:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075822.925364:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700759296 00000100:00100000:1.0:1787075822.925371:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700759296 00000100:00100000:2.0:1787075822.925392:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961894a1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787075822.926305:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787075822.926319:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191062450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700759296:12345-0@lo:501: 00000100:00100000:1.0:1787075822.931346:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191062450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700759296:12345-0@lo:501: Request processed in 5016us (6424us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787075822.931368:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787075822.931375:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700759296:0@lo:501: 10000000:01000000:2.0:1787075822.931435:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787075822.931451:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f47f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f486 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075822.931466:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f47f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f486 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1787075822.934509:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b9df8e00 x1873884700758912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787075832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075822.934531:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787075822.934617:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787075822.934631:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787075822.934864:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787075822.934870:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961c180b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787075822.934979:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787075822.934988:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700758912:0@lo:8: 00000004:00080000:2.0:1787075822.935080:0:7836:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787075822.935469:0:7836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 204910828045ns, next at 0ns, rc = 0 00000004:00080000:1.0:1787075823.061156:0:7837:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787075823.061191:0:7837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7837:1873884700759552:0@lo:7: 00000100:00100000:1.0:1787075823.061269:0:7837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075823.061318:0:7837:0:(client.c:2702:ptlrpc_set_wait()) set ffff99619036b240 going to sleep for 11 seconds 00000004:00080000:1.0:1787075823.061346:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787075823.061374:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700759424:0@lo:13: 00000100:00100000:1.0:1787075823.061397:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075823.061430:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700759552 00000100:00100000:1.0:1787075823.061437:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700759552 00000100:00100000:1.0:1787075823.061482:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787075823.061491:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7837:x1873884700759552:12345-0@lo:7: 00000100:00080000:0.0:1787075823.064724:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787075823.064758:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700759424 00000100:00100000:0.0:1787075823.064770:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700759424 00000100:00100000:0.0:1787075823.064844:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787075823.064855:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1873884700759424:12345-0@lo:13: 00002000:00000024:0.0:1787075823.064900:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787075823.065003:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1873884700759424:12345-0@lo:13: Request processed in 150us (3604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075823.065011:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787075823.069776:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f55500 x1873884700759424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075823.069802:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700759424:0@lo:13: 00002000:00080000:1.0:1787075823.070365:0:6704:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787075823.070377:0:6704:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787075823.070516:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7837:x1873884700759552:12345-0@lo:7: Request processed in 9025us (9246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075823.070528:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787075823.070629:0:7837:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f56a00 x1873884700759552/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787075839 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075823.070742:0:7837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7837:1873884700759552:0@lo:7: 00000004:00080000:0.0:1787075823.070755:0:7837:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787075823.070790:0:7837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7837:1873884700759680:0@lo:5: 00000100:00100000:0.0:1787075823.070834:0:7837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075823.070902:0:7837:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187940780 going to sleep for 11 seconds 00000100:00100000:1.0:1787075823.071062:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700759680 00000100:00100000:1.0:1787075823.071068:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700759680 00000100:00100000:1.0:1787075823.071139:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787075823.071149:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7837:x1873884700759680:12345-0@lo:5: 00002000:00080000:1.0:1787075823.071173:0:6706:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787075823.071176:0:6706:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787075823.071394:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7837:x1873884700759680:12345-0@lo:5: Request processed in 245us (559us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787075823.071401:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787075823.071599:0:7837:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b9dfb480 x1873884700759680/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787075839 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075823.071611:0:7837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7837:1873884700759680:0@lo:5: 00000004:00080000:0.0:1787075823.071619:0:7837:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787075823.071673:0:7837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7837:1873884700759808:0@lo:700: 00000100:00100000:0.0:1787075823.071700:0:7837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075823.071718:0:7837:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187940780 going to sleep for 11 seconds 00000100:00100000:1.0:1787075823.071818:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700759808 00000100:00100000:1.0:1787075823.071824:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700759808 00000100:00100000:1.0:1787075823.071882:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787075823.071890:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7837:x1873884700759808:12345-0@lo:700: 00000100:00100000:1.0:1787075823.071917:0:6712:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f54700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6712:1873884700759936:0@lo:700: 00000100:00100000:1.0:1787075823.071946:0:6712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075823.072029:0:6712:0:(client.c:2702:ptlrpc_set_wait()) set ffff99619036b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787075823.072089:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700759936 00000100:00100000:3.0:1787075823.072094:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700759936 00000100:00100000:3.0:1787075823.072133:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787075823.072140:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6712:x1873884700759936:12345-0@lo:700: 40000000:02000000:2.0:1787075823.200742:0:5859:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1787075823.218899:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6712:x1873884700759936:12345-0@lo:700: Request processed in 146750us (146943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075823.218914:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787075823.219572:0:6712:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f54700 x1873884700759936/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787075839 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075823.219602:0:6712:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f54700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6712:1873884700759936:0@lo:700: 40000000:02000000:1.0:1787075823.219615:0:6712:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1787075823.344121:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1787075823.344137:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787075823.344292:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7837:x1873884700759808:12345-0@lo:700: Request processed in 272398us (272586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075823.344306:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787075823.344428:0:7837:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b9df8380 x1873884700759808/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787075839 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075823.344439:0:7837:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787075823.344458:0:7837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7837:1873884700759808:0@lo:700: 00000004:02000040:0.0:1787075823.438207:0:7837:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1787075823.445655:0:7837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7837:1873884700760064:0@lo:5: 00000100:00100000:2.0:1787075823.445733:0:7837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075823.445859:0:7837:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961894a1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787075823.448210:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700760064 00000100:00100000:1.0:1787075823.448222:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700760064 00000100:00100000:1.0:1787075823.454509:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787075823.454535:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7837:x1873884700760064:12345-0@lo:5: 00002000:00080000:1.0:1787075823.460310:0:6704:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787075823.460330:0:6704:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787075823.464275:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7837:x1873884700760064:12345-0@lo:5: Request processed in 9747us (18536us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787075823.464288:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787075823.464495:0:7837:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b00fd880 x1873884700760064/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787075839 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787075823.464512:0:7837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7837:1873884700760064:0@lo:5: 00000004:00080000:2.0:1787075823.464525:0:7837:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1787075823.509336:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075824.332506:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787075824.332532:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700760192:0@lo:13: 00000100:00100000:0.0:1787075824.332611:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075824.332691:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700760192 00000100:00100000:0.0:1787075824.332699:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700760192 00000100:00100000:0.0:1787075824.332913:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787075824.332923:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700760192:12345-0@lo:13: 00002000:00000024:0.0:1787075824.333456:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787075824.333519:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700760192:12345-0@lo:13: Request processed in 597us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075824.333527:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787075824.333556:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787075824.333869:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b9df8380 x1873884700760192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075824.333890:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700760192:0@lo:13: 00010000:00010000:3.0:1787075824.519758:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075825.548069:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787075826.189483:0:8006:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787075826.568682:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075827.596248:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075828.425141:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700760320:0@lo:13: 00000100:00100000:0.0:1787075828.425216:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075828.425399:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700760320 00000100:00100000:2.0:1787075828.425409:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700760320 00000100:00100000:2.0:1787075828.425484:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787075828.425494:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1873884700760320:12345-0@lo:13: 00002000:00000024:2.0:1787075828.425529:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075828.425582:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1873884700760320:12345-0@lo:13: Request processed in 89us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075828.425589:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787075828.428224:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700760448:0@lo:400: 00000100:00100000:1.0:1787075828.428294:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075828.435288:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700760448 00000100:00100000:3.0:1787075828.435304:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700760448 00000100:00100000:1.0:1787075828.437001:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700760576:0@lo:400: 00000100:00100000:1.0:1787075828.437096:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075828.437126:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787075828.437132:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700760704:0@lo:400: 00000100:00100000:1.0:1787075828.437150:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075828.437179:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700760576 00000100:00100000:1.0:1787075828.437185:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700760576 00000100:00100000:1.0:1787075828.437221:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700760704 00000100:00100000:1.0:1787075828.437240:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700760704 00000100:00100000:1.0:1787075828.437261:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787075828.437268:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700760576:12345-0@lo:400: 00000100:00100000:1.0:1787075828.437339:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700760576:12345-0@lo:400: Request processed in 70us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075828.437345:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787075828.437369:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787075828.437375:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700760704:12345-0@lo:400: 00000100:00100000:1.0:1787075828.437403:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700760704:12345-0@lo:400: Request processed in 29us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075828.437409:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787075828.437546:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f54380 x1873884700760704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075828.437560:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700760704:0@lo:400: 00010000:00080000:1.0:1787075828.437569:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f55880 x1873884700760576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075828.437576:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700760576:0@lo:400: 00000100:00100000:3.0:1787075828.437927:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787075828.437934:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3312:x1873884700760448:12345-0@lo:400: 00000100:00100000:3.0:1787075828.437975:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3312:x1873884700760448:12345-0@lo:400: Request processed in 42us (9681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075828.437980:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787075828.438697:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700760448:0@lo:400: 00000100:00100000:1.0:1787075828.438718:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700760960:0@lo:400: 00000100:00100000:1.0:1787075828.438753:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075828.438778:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700760960 00000100:00100000:1.0:1787075828.438783:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700760960 00000100:00100000:1.0:1787075828.438815:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787075828.438822:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700760960:12345-0@lo:400: 00000100:00100000:1.0:1787075828.438856:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700760960:12345-0@lo:400: Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075828.438862:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787075828.438890:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f55500 x1873884700760960/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075828.438901:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700760960:0@lo:400: 00000100:00100000:1.0:1787075828.438926:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787075828.438934:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700760832:0@lo:400: 00000100:00100000:1.0:1787075828.438960:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075828.438983:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700760832 00000100:00100000:1.0:1787075828.438986:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700760832 00000100:00100000:1.0:1787075828.439012:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787075828.439018:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700760832:12345-0@lo:400: 00000100:00100000:1.0:1787075828.439053:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700760832:12345-0@lo:400: Request processed in 35us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075828.439060:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787075828.439080:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f56a00 x1873884700760832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075828.439088:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700760832:0@lo:400: 00010000:00080000:1.0:1787075828.439168:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b00fd500 x1873884700760320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075828.439185:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700760320:0@lo:13: 00000100:00080000:1.0:1787075828.439208:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787075828.439214:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787075828.439216:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787075828.539448:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1787075828.616105:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075829.448881:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787075829.448910:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700761088:0@lo:13: 00000100:00100000:0.0:1787075829.448984:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075829.449046:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700761088 00000100:00100000:0.0:1787075829.449054:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700761088 00000100:00100000:0.0:1787075829.449107:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787075829.449116:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700761088:12345-0@lo:13: 00002000:00000024:0.0:1787075829.449154:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787075829.449210:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700761088:12345-0@lo:13: Request processed in 94us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075829.449217:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787075829.449584:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961c1880380 x1873884700761088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787075829.449603:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700761088:0@lo:13: 00010000:00010000:1.0:1787075829.640931:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075830.665385:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075831.699075:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075831.959763:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075831.961295:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678717568 00000100:00100000:2.0:1787075831.961311:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678717568 00000100:00100000:0.0:1787075831.961601:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 111 00000100:00100000:0.0:1787075831.961611:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1873884678717568:12345-192.168.204.50@tcp:250: 00010000:00080000:0.0:1787075831.961679:0:5847:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 3fbce478-41bc-496b-b8c6-033a0ad89c67@192.168.204.50@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1787075831.961714:0:5847:0:(genops.c:1406:class_connect()) connect: client 3fbce478-41bc-496b-b8c6-033a0ad89c67, cookie 0x859911ad6869f48d 00000100:00080000:0.0:1787075831.963515:0:5847:0:(import.c:65:import_set_state_nolock()) ffff9961bfdca800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787075831.963600:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+5:2358:x1873884678717568:12345-192.168.204.50@tcp:250: Request processed in 1987us (3848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075831.963612:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 111 00000100:00100000:3.0:1787075831.971983:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075831.972140:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678717696 00000100:00100000:1.0:1787075831.972153:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678717696 00000100:00100000:1.0:1787075831.972233:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 112 00000100:00100000:1.0:1787075831.972244:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191060850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+5:5588:x1873884678717696:12345-192.168.204.50@tcp:101: 00010000:00010000:1.0:1787075831.972284:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075831.972315:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996190039000/0x859911ad6869f494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76232c7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075831.972350:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996190039000/0x859911ad6869f494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232c7 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075831.972362:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996190039000/0x859911ad6869f494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232c7 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075831.972374:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190039000, rc 0) 00000100:00100000:1.0:1787075831.972444:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191060850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+6:5588:x1873884678717696:12345-192.168.204.50@tcp:101: Request processed in 203us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075831.972452:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 112 00000100:00100000:3.0:1787075831.976970:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075831.977101:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678717824 00000100:00100000:0.0:1787075831.977120:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678717824 00000100:00100000:0.0:1787075831.977229:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 113 00000100:00100000:0.0:1787075831.977249:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+6:5588:x1873884678717824:12345-192.168.204.50@tcp:501: 00000100:00100000:0.0:1787075831.977743:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+6:5588:x1873884678717824:12345-192.168.204.50@tcp:501: Request processed in 502us (1119us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787075831.977752:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 113 00000100:00100000:3.0:1787075832.016156:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075832.016214:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678717952 00000100:00100000:3.0:1787075832.016226:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678717952 00000100:00100000:3.0:1787075832.016308:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:3.0:1787075832.016321:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+6:5588:x1873884678717952:12345-192.168.204.50@tcp:101: 00010000:00010000:3.0:1787075832.016344:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075832.016369:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996183be6e00/0x859911ad6869f49b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76232ce expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075832.016407:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996183be6e00/0x859911ad6869f49b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232ce expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075832.016420:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996183be6e00/0x859911ad6869f49b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232ce expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075832.016432:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996183be6e00, rc 0) 00000100:00100000:3.0:1787075832.016515:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+7:5588:x1873884678717952:12345-192.168.204.50@tcp:101: Request processed in 195us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075832.016523:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:3.0:1787075832.020667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075832.022022:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678718080 00000100:00100000:2.0:1787075832.022037:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678718080 00000100:00100000:2.0:1787075832.022105:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00100000:2.0:1787075832.022116:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+7:5588:x1873884678718080:12345-192.168.204.50@tcp:501: 00000100:00100000:2.0:1787075832.022620:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+8:5588:x1873884678718080:12345-192.168.204.50@tcp:501: Request processed in 503us (1990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075832.022629:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00100000:3.0:1787075832.032611:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075832.033595:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678718208 00000100:00100000:0.0:1787075832.033616:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678718208 00000100:00100000:0.0:1787075832.033751:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 116 00000100:00100000:0.0:1787075832.033764:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+8:5588:x1873884678718208:12345-192.168.204.50@tcp:503: 00000100:00100000:0.0:1787075832.034574:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+8:5588:x1873884678718208:12345-192.168.204.50@tcp:503: Request processed in 807us (1967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075832.034587:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 116 00000100:00100000:2.0:1787075832.041065:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075832.041150:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678718336 00000100:00100000:0.0:1787075832.041171:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678718336 00000100:00100000:0.0:1787075832.041275:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:0.0:1787075832.041295:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+8:5606:x1873884678718336:12345-192.168.204.50@tcp:502: 00000100:00100000:0.0:1787075832.041949:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+8:5606:x1873884678718336:12345-192.168.204.50@tcp:502: Request processed in 659us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075832.041959:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:0.0:1787075832.092432:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075832.092489:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678718464 00000100:00100000:0.0:1787075832.092500:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678718464 00000100:00100000:0.0:1787075832.092596:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 118 00000100:00100000:0.0:1787075832.092609:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+8:5606:x1873884678718464:12345-192.168.204.50@tcp:502: 00000100:00100000:0.0:1787075832.092982:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+8:5606:x1873884678718464:12345-192.168.204.50@tcp:502: Request processed in 375us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075832.092990:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 118 00000100:00100000:1.0:1787075832.110297:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075832.110426:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678718592 00000100:00100000:2.0:1787075832.110438:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678718592 00000100:00100000:2.0:1787075832.110502:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 119 00000100:00100000:2.0:1787075832.110513:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+8:5588:x1873884678718592:12345-192.168.204.50@tcp:101: 00010000:00010000:2.0:1787075832.110557:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075832.110592:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181523200/0x859911ad6869f4a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76232f8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075832.110626:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181523200/0x859911ad6869f4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232f8 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075832.110680:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181523200/0x859911ad6869f4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232f8 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075832.110692:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523200, rc 0) 00000100:00100000:2.0:1787075832.110756:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:5588:x1873884678718592:12345-192.168.204.50@tcp:101: Request processed in 245us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075832.110764:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 119 00000100:00100000:1.0:1787075832.117205:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075832.117325:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678718720 00000100:00100000:2.0:1787075832.117338:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678718720 00000100:00100000:2.0:1787075832.117399:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 120 00000100:00100000:2.0:1787075832.117410:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:5588:x1873884678718720:12345-192.168.204.50@tcp:256: 20000000:01000000:2.0:1787075832.117445:0:5847:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787075832.117472:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787075832.117477:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787075832.117480:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787075832.117483:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787075832.124005:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:5588:x1873884678718720:12345-192.168.204.50@tcp:256: Request processed in 6580us (6800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075832.124026:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 120 00000100:00100000:1.0:1787075832.135899:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075832.135977:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678718848 00000100:00100000:0.0:1787075832.135990:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678718848 00000100:00100000:0.0:1787075832.136045:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 121 00000100:00100000:0.0:1787075832.136055:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619102a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:5588:x1873884678718848:12345-192.168.204.50@tcp:101: 00010000:00010000:0.0:1787075832.136073:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075832.136092:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181497600/0x859911ad6869f4a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76232ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075832.136122:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181497600/0x859911ad6869f4a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232ff expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075832.136134:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181497600/0x859911ad6869f4a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232ff expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075832.136143:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181497600, rc 0) 00000100:00100000:0.0:1787075832.136203:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619102a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:5588:x1873884678718848:12345-192.168.204.50@tcp:101: Request processed in 149us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075832.136210:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 121 00000100:00100000:1.0:1787075832.141783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075832.142056:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678718976 00000100:00100000:3.0:1787075832.142066:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678718976 00000100:00100000:3.0:1787075832.142133:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 122 00000100:00100000:3.0:1787075832.142145:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619102b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:5588:x1873884678718976:12345-192.168.204.50@tcp:501: 00000100:00100000:3.0:1787075832.142477:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619102b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:5588:x1873884678718976:12345-192.168.204.50@tcp:501: Request processed in 333us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075832.142485:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 122 00000100:00100000:1.0:1787075832.144444:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075832.144509:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678719104 00000100:00100000:3.0:1787075832.144519:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678719104 00000100:00100000:3.0:1787075832.144572:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 123 00000100:00100000:3.0:1787075832.144582:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619102bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:5588:x1873884678719104:12345-192.168.204.50@tcp:503: 00000100:00100000:3.0:1787075832.145000:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619102bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:5588:x1873884678719104:12345-192.168.204.50@tcp:503: Request processed in 417us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075832.145008:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 123 00000100:00100000:1.0:1787075832.171562:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075832.171928:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678719232 00000100:00100000:3.0:1787075832.171945:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678719232 00000100:00100000:3.0:1787075832.172010:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 124 00000100:00100000:3.0:1787075832.172021:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619102b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:5609:x1873884678719232:12345-192.168.204.50@tcp:502: 00000100:00100000:3.0:1787075832.172277:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619102b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:5609:x1873884678719232:12345-192.168.204.50@tcp:502: Request processed in 257us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075832.172286:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 124 00000100:00100000:1.0:1787075832.175298:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075832.175386:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678719360 00000100:00100000:3.0:1787075832.175396:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678719360 00000100:00100000:3.0:1787075832.175454:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 125 00000100:00100000:3.0:1787075832.175465:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:5609:x1873884678719360:12345-192.168.204.50@tcp:502: 00000100:00100000:3.0:1787075832.176011:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:5609:x1873884678719360:12345-192.168.204.50@tcp:502: Request processed in 546us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075832.176019:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 125 00000100:00100000:3.0:1787075832.185670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075832.186085:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678719488 00000100:00100000:3.0:1787075832.186098:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678719488 00000100:00100000:3.0:1787075832.186141:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:3.0:1787075832.186150:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2358:x1873884678719488:12345-192.168.204.50@tcp:38: 00010000:00080000:3.0:1787075832.186191:0:7654:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:3.0:1787075832.186602:0:7654:0:(genops.c:1406:class_connect()) connect: client a850c61f-0242-4b36-8952-7b46dff1f2b9, cookie 0x859911ad6869f4b0 00000004:00100000:3.0:1787075832.186792:0:7654:0:(mdt_handler.c:7347:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787075832.186799:0:7654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787075832.227439:0:7654:0:(import.c:65:import_set_state_nolock()) ffff9961bfdca000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787075832.227535:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2358:x1873884678719488:12345-192.168.204.50@tcp:38: Request processed in 41384us (41875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075832.227547:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00010000:00010000:2.0:1787075832.714341:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075833.234513:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075833.234952:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678719616 00000100:00100000:2.0:1787075833.234976:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678719616 00000100:00100000:2.0:1787075833.235063:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:2.0:1787075833.235075:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:0:x1873884678719616:12345-192.168.204.50@tcp:41: 00000004:00000024:2.0:1787075833.235118:0:5854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787075833.235185:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:0:x1873884678719616:12345-192.168.204.50@tcp:41: Request processed in 112us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075833.235194:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00080000:1.0:1787075833.235254:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075833.235750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075833.235956:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678719744 00000100:00100000:3.0:1787075833.235964:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678719744 00000100:00100000:3.0:1787075833.236003:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:3.0:1787075833.236010:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:5588:x1873884678719744:12345-192.168.204.50@tcp:41: 00000004:00000024:3.0:1787075833.236027:0:5853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787075833.236073:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:5588:x1873884678719744:12345-192.168.204.50@tcp:41: Request processed in 63us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075833.236079:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:3.0:1787075833.246331:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075833.246540:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678719872 00000100:00100000:2.0:1787075833.246550:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678719872 00000100:00100000:2.0:1787075833.248834:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:2.0:1787075833.248860:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:5588:x1873884678719872:12345-192.168.204.50@tcp:40: 00000100:00100000:2.0:1787075833.250195:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:5588:x1873884678719872:12345-192.168.204.50@tcp:40: Request processed in 1339us (3866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075833.250207:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:1.0:1787075833.261877:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075833.262148:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678720000 00000100:00100000:0.0:1787075833.262165:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678720000 00000100:00100000:0.0:1787075833.262247:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:0.0:1787075833.262257:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1873884678720000:12345-192.168.204.50@tcp:8: 00010000:00080000:0.0:1787075833.262297:0:6704:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:0.0:1787075833.262333:0:6704:0:(genops.c:1406:class_connect()) connect: client a850c61f-0242-4b36-8952-7b46dff1f2b9, cookie 0x859911ad6869f4b7 00002000:00100000:0.0:1787075833.262724:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a850c61f-0242-4b36-8952-7b46dff1f2b9/ffff9961bfdc9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787075833.262751:0:6704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787075833.266850:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787075833.266917:0:6704:0:(import.c:65:import_set_state_nolock()) ffff9961bfdcb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787075833.267100:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2358:x1873884678720000:12345-192.168.204.50@tcp:8: Request processed in 4838us (5242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075833.267113:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:3.0:1787075833.267688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075833.267807:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075833.267858:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075833.268688:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678720128 00000100:00100000:1.0:1787075833.268703:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678720128 00000100:00100000:1.0:1787075833.268754:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:1.0:1787075833.268763:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1873884678720128:12345-192.168.204.50@tcp:8: 00000100:00100000:3.0:1787075833.268771:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678720384 00000100:00100000:3.0:1787075833.268781:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678720384 00010000:00080000:1.0:1787075833.268834:0:6706:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp t0 exp 0000000000000000 cur 215 last 0 00000100:00100000:3.0:1787075833.268843:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 126 00000100:00100000:3.0:1787075833.268856:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2362:x1873884678720384:12345-192.168.204.50@tcp:400: 00000020:00000080:1.0:1787075833.268868:0:6706:0:(genops.c:1406:class_connect()) connect: client a850c61f-0242-4b36-8952-7b46dff1f2b9, cookie 0x859911ad6869f4be 00002000:00100000:1.0:1787075833.268886:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a850c61f-0242-4b36-8952-7b46dff1f2b9/ffff9961bf066000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787075833.268916:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787075833.268965:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2362:x1873884678720384:12345-192.168.204.50@tcp:400: Request processed in 110us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075833.268975:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 126 00002000:00080000:1.0:1787075833.269599:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787075833.269729:0:6706:0:(import.c:65:import_set_state_nolock()) ffff9961bf064800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787075833.269797:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2358:x1873884678720128:12345-192.168.204.50@tcp:8: Request processed in 1034us (1938us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075833.269807:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:0.0:1787075833.271052:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678720256 00000100:00100000:0.0:1787075833.271064:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678720256 00000100:00100000:0.0:1787075833.271182:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:0.0:1787075833.271194:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:5588:x1873884678720256:12345-192.168.204.50@tcp:33: 00000004:00080000:0.0:1787075833.322622:0:5855:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 51253us 00000004:00200000:2.0:1787075833.373148:0:5855:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787075833.377911:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:5588:x1873884678720256:12345-192.168.204.50@tcp:33: Request processed in 106702us (110252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075833.377941:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:1.0:1787075833.543996:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700761344:0@lo:400: 00000100:00100000:0.0:1787075833.544200:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700761216:0@lo:400: 00000100:00100000:0.0:1787075833.544283:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075833.544348:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873884700761728:0@lo:400: 00000100:00100000:0.0:1787075833.544376:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075833.544410:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787075833.544416:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700761600:0@lo:400: 00000100:00100000:0.0:1787075833.544444:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075833.544483:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700761728 00000100:00100000:0.0:1787075833.544493:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700761728 00000100:00100000:0.0:1787075833.544562:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787075833.544573:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873884700761728:12345-0@lo:400: 00000100:00100000:0.0:1787075833.544673:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873884700761728:12345-0@lo:400: Request processed in 100us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075833.544703:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787075833.544734:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700761600 00000100:00100000:0.0:1787075833.544738:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700761600 00000100:00100000:0.0:1787075833.544783:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787075833.544790:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700761600:12345-0@lo:400: 00000100:00100000:0.0:1787075833.544824:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700761600:12345-0@lo:400: Request processed in 35us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075833.544831:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787075833.544854:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787075833.544861:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787075833.544896:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961bf3a7480 x1873884700761600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075833.544914:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700761600:0@lo:400: 00010000:00080000:0.0:1787075833.544926:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961bf3a5c00 x1873884700761728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075833.544935:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873884700761728:0@lo:400: 00000100:00100000:0.0:1787075833.544990:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700761216 00000100:00100000:0.0:1787075833.544994:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700761216 00000100:00100000:0.0:1787075833.545020:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787075833.545028:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700761216:12345-0@lo:400: 00000100:00100000:3.0:1787075833.545565:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700761472:0@lo:400: 00000100:00100000:1.0:1787075833.547674:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075833.547756:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700761856:0@lo:400: 00000100:00100000:1.0:1787075833.547810:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075833.547896:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700761856 00000100:00100000:1.0:1787075833.547905:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700761856 00000100:00100000:1.0:1787075833.547977:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787075833.547989:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700761856:12345-0@lo:400: 00000100:00100000:1.0:1787075833.548061:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700761856:12345-0@lo:400: Request processed in 74us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075833.548070:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787075833.548097:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787075833.548136:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961bf3a4e00 x1873884700761856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075833.548147:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787075833.548168:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700761856:0@lo:400: 00000100:00100000:2.0:1787075833.551178:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700761344 00000100:00100000:2.0:1787075833.551212:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700761344 00000100:00100000:2.0:1787075833.551312:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787075833.551329:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700761344:12345-0@lo:400: 00000100:00100000:2.0:1787075833.551464:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700761344:12345-0@lo:400: Request processed in 137us (3798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075833.551472:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787075833.551930:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961bf3a4a80 x1873884700761344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075833.551951:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700761344:0@lo:400: 00000100:00100000:0.0:1787075833.564309:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700761216:12345-0@lo:400: Request processed in 19265us (20009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075833.564331:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787075833.564421:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700761216:0@lo:400: 00000100:00100000:3.0:1787075833.567041:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075833.567152:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700761984:0@lo:13: 00000100:00100000:3.0:1787075833.567213:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075833.567707:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700761472 00000100:00100000:0.0:1787075833.567720:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700761472 00000100:00100000:0.0:1787075833.567823:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787075833.567844:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700761472:12345-0@lo:400: 00000100:00100000:0.0:1787075833.567929:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700761472:12345-0@lo:400: Request processed in 88us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075833.567938:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787075833.568036:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787075833.570885:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961bf3a5880 x1873884700761472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787075849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075833.570911:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700761472:0@lo:400: 00000100:00100000:2.0:1787075833.571275:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700761984 00000100:00100000:2.0:1787075833.571287:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700761984 00000100:00100000:2.0:1787075833.571387:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787075833.571397:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700761984:12345-0@lo:13: 00002000:00000024:2.0:1787075833.571434:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075833.571901:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700761984:12345-0@lo:13: Request processed in 505us (4686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075833.571909:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787075833.575204:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b00fc000 x1873884700761984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075833.575242:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700761984:0@lo:13: 00000100:00100000:3.0:1787075833.619429:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075833.619584:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678720512 00000100:00100000:0.0:1787075833.619597:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678720512 00000100:00100000:0.0:1787075833.619737:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:0.0:1787075833.619750:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:5625:x1873884678720512:12345-192.168.204.50@tcp:101: 00010000:00010000:0.0:1787075833.619777:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075833.620880:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038800/0x859911ad6869f4c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623329 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075833.620968:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039a00/0x859911ad6869f4cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075833.620982:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190039a00/0x859911ad6869f4cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075833.620997:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190039a00/0x859911ad6869f4cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075833.621231:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787075833.621236:0:5852:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787075833.621317:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996190039a00/0x859911ad6869f4cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075833.621348:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038800/0x859911ad6869f4c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623329 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075833.621366:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039a00/0x859911ad6869f4cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623329 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075833.621374:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996187c34500) 00010000:00010000:1.0:1787075833.621384:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787075833.621387:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190039a00, rc 0) 00000100:00100000:1.0:1787075833.621699:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:5625:x1873884678720512:12345-192.168.204.50@tcp:101: Request processed in 1949us (2285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075833.621709:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00010000:00010000:0.0:1787075833.735897:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787075834.569231:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700762112:0@lo:13: 00000100:00100000:3.0:1787075834.569349:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075834.570998:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700762112 00000100:00100000:0.0:1787075834.571012:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700762112 00000100:00100000:0.0:1787075834.575719:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787075834.575746:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700762112:12345-0@lo:13: 00002000:00000024:0.0:1787075834.575777:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787075834.575883:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700762112:12345-0@lo:13: Request processed in 151us (6534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075834.575891:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787075834.576006:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961c1883b80 x1873884700762112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075834.576030:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700762112:0@lo:13: 00010000:00010000:2.0:1787075834.759961:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075835.771741:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075835.771914:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678720640 00000100:00100000:0.0:1787075835.771925:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678720640 00000100:00100000:0.0:1787075835.772009:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:0.0:1787075835.772020:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:5679:x1873884678720640:12345-192.168.204.50@tcp:41: 00000004:00000024:0.0:1787075835.772066:0:5853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787075835.772142:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:5679:x1873884678720640:12345-192.168.204.50@tcp:41: Request processed in 124us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075835.772150:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00080000:1.0:1787075835.773052:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787075835.776731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075835.776914:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678720768 00000100:00100000:2.0:1787075835.776929:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678720768 00000100:00100000:2.0:1787075835.777029:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:2.0:1787075835.777040:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:5679:x1873884678720768:12345-192.168.204.50@tcp:13: 00002000:00000024:2.0:1787075835.777096:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075835.777177:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:5679:x1873884678720768:12345-192.168.204.50@tcp:13: Request processed in 138us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075835.777185:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00080000:1.0:1787075835.777357:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787075835.780864:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075835.781009:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678720896 00000100:00100000:1.0:1787075835.781021:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678720896 00000100:00100000:1.0:1787075835.781104:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:1.0:1787075835.781115:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:5679:x1873884678720896:12345-192.168.204.50@tcp:13: 00002000:00000024:1.0:1787075835.781151:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075835.781220:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:5679:x1873884678720896:12345-192.168.204.50@tcp:13: Request processed in 106us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075835.781228:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00080000:0.0:1787075835.781381:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787075835.786069:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787075836.260682:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a850c61f-0242-4b36-8952-7b46dff1f2b9 00010000:00010000:2.0:1787075836.808023:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787075837.816485:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a850c61f-0242-4b36-8952-7b46dff1f2b9 00010000:00010000:0.0:1787075837.836258:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787075838.263877:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a850c61f-0242-4b36-8952-7b46dff1f2b9 00000100:00100000:0.0:1787075838.665359:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700762624:0@lo:400: 00000100:00100000:0.0:1787075838.665460:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075838.665569:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787075838.665576:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700762240:0@lo:400: 00000100:00100000:0.0:1787075838.665627:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075838.665683:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700762752:0@lo:400: 00000100:00100000:0.0:1787075838.665712:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075838.665744:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700762496:0@lo:400: 00000100:00100000:0.0:1787075838.665769:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075838.665788:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787075838.665794:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700762368:0@lo:400: 00000100:00100000:0.0:1787075838.665818:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075838.665837:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700762880:0@lo:400: 00000100:00100000:0.0:1787075838.665861:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075838.665893:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700762240 00000100:00100000:0.0:1787075838.665905:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700762240 00000100:00100000:1.0:1787075838.666394:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700762624 00000100:00100000:1.0:1787075838.666401:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700762624 00000100:00100000:1.0:1787075838.666458:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700762880 00000100:00100000:1.0:1787075838.666462:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700762880 00000100:00100000:1.0:1787075838.666488:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787075838.666498:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700762624:12345-0@lo:400: 00000100:00100000:1.0:1787075838.666601:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700762624:12345-0@lo:400: Request processed in 104us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075838.666610:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787075838.666634:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787075838.666666:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700762880:12345-0@lo:400: 00000100:00100000:1.0:1787075838.666722:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700762880:12345-0@lo:400: Request processed in 82us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075838.666729:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787075838.666750:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700762752 00000100:00100000:1.0:1787075838.666754:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700762752 00000100:00100000:1.0:1787075838.666787:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700762496 00000100:00100000:1.0:1787075838.666791:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700762496 00000100:00100000:1.0:1787075838.666805:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700762368 00000100:00100000:1.0:1787075838.666807:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700762368 00000100:00100000:1.0:1787075838.666822:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787075838.666828:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700762752:12345-0@lo:400: 00000100:00100000:1.0:1787075838.666865:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700762752:12345-0@lo:400: Request processed in 37us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075838.666872:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787075838.666885:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787075838.666892:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700762496:12345-0@lo:400: 00000100:00100000:1.0:1787075838.666920:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700762496:12345-0@lo:400: Request processed in 29us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075838.666927:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787075838.666953:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787075838.666960:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700762368:12345-0@lo:400: 00000100:00100000:1.0:1787075838.666991:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700762368:12345-0@lo:400: Request processed in 32us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075838.666998:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787075838.667024:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787075838.667030:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787075838.667033:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787075838.667082:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700762368:0@lo:400: 00010000:00080000:1.0:1787075838.667110:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961c1881880 x1873884700762880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075838.667123:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700762880:0@lo:400: 00000100:00100000:1.0:1787075838.667596:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700762496:0@lo:400: 00000100:00100000:1.0:1787075838.667690:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700762752:0@lo:400: 00010000:00080000:1.0:1787075838.667706:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961c1883800 x1873884700762624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075838.667716:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700762624:0@lo:400: 00000100:00100000:0.0:1787075838.667851:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787075838.667864:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700762240:12345-0@lo:400: 00000100:00100000:0.0:1787075838.667920:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700762240:12345-0@lo:400: Request processed in 60us (2306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075838.667927:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787075838.668701:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700762240:0@lo:400: 00000100:00100000:1.0:1787075838.671107:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787075838.671217:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700763008:0@lo:13: 00000100:00100000:1.0:1787075838.671313:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075838.674302:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700763008 00000100:00100000:0.0:1787075838.674319:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700763008 00000100:00100000:0.0:1787075838.674398:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787075838.674426:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700763008:12345-0@lo:13: 00002000:00000024:0.0:1787075838.674481:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787075838.674618:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700763008:12345-0@lo:13: Request processed in 196us (3305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075838.674626:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787075838.674848:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961c1882300 x1873884700763008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787075838.674876:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700763008:0@lo:13: 00000100:00100000:3.0:1787075838.749026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075838.749906:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075838.749933:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075838.750000:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075838.750059:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678721280 00000100:00100000:3.0:1787075838.750072:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678721280 00000100:00100000:3.0:1787075838.750151:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678721408 00000100:00100000:3.0:1787075838.750155:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678721408 00000100:00100000:3.0:1787075838.750178:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:3.0:1787075838.750191:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2359:x1873884678721280:12345-192.168.204.50@tcp:400: 00000100:00100000:3.0:1787075838.750294:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2359:x1873884678721280:12345-192.168.204.50@tcp:400: Request processed in 106us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075838.750317:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:3.0:1787075838.750336:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:3.0:1787075838.750344:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf654e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2359:x1873884678721408:12345-192.168.204.50@tcp:400: 00000100:00100000:3.0:1787075838.750371:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf654e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2359:x1873884678721408:12345-192.168.204.50@tcp:400: Request processed in 27us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075838.750377:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00080000:3.0:1787075838.750395:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787075838.750399:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787075838.751207:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678721152 00000100:00100000:2.0:1787075838.751220:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678721152 00000100:00100000:2.0:1787075838.751305:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:2.0:1787075838.751317:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678721152:12345-192.168.204.50@tcp:400: 00000100:00100000:2.0:1787075838.751395:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678721152:12345-192.168.204.50@tcp:400: Request processed in 80us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075838.751403:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00080000:3.0:1787075838.755809:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787075838.757632:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678721024 00000100:00100000:0.0:1787075838.757882:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678721024 00000100:00100000:0.0:1787075838.757983:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 129 00000100:00100000:0.0:1787075838.757997:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2359:x1873884678721024:12345-192.168.204.50@tcp:400: 00000100:00100000:0.0:1787075838.758519:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2359:x1873884678721024:12345-192.168.204.50@tcp:400: Request processed in 522us (9508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075838.758530:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 129 00010000:00010000:2.0:1787075838.858570:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787075839.286708:0:8313:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1787075839.691129:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700763136:0@lo:13: 00000100:00100000:2.0:1787075839.691197:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075839.693055:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700763136 00000100:00100000:0.0:1787075839.693085:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700763136 00000100:00100000:0.0:1787075839.693177:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787075839.693190:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700763136:12345-0@lo:13: 00002000:00000024:0.0:1787075839.693241:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787075839.693359:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700763136:12345-0@lo:13: Request processed in 171us (2161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075839.693367:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787075839.693432:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b00fc700 x1873884700763136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075839.693457:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700763136:0@lo:13: 00010000:00010000:0.0:1787075839.883088:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075840.908362:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075841.929061:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075842.955276:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787075843.217785:0:8460:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce29f2370 20000000:00000080:1.0:1787075843.217802:0:8460:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9961c1e31800 uarg=0000000000000000 20000000:01000000:1.0:1787075843.217836:0:8460:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787075843.217839:0:8460:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787075843.217842:0:8460:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787075843.217846:0:8460:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787075843.217852:0:8460:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787075843.217867:0:8460:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787075843.217869:0:8460:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787075843.218211:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787075843.218214:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787075843.220186:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1787075843.221149:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1787075843.221220:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1787075843.221256:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1787075843.221279:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787075843.221282:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787075843.222280:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1787075843.223029:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1787075843.223080:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1787075843.223131:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1787075843.223145:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787075843.223147:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787075843.224296:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787075843.224934:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787075843.224995:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787075843.225034:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1787075843.225046:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787075843.225048:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787075843.225838:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1787075843.226191:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1787075843.226232:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1787075843.226259:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:2.0:1787075843.226272:0:8460:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787075843.226291:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9961b9032e00/0x859911ad6869f4d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.226310:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996183be6c00/0x859911ad6869f3d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f3c9 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.226319:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181522a00/0x859911ad6869f3fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f3f3 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.226326:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181523600/0x859911ad6869f424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f41d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.226333:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181522000/0x859911ad6869f432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f42b expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.226339:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996183be6400/0x859911ad6869f440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f439 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.226352:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996190039600/0x859911ad6869f45c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f455 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.226359:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181523400/0x859911ad6869f486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f47f expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.226369:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996190039000/0x859911ad6869f494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232c7 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.226376:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996183be6e00/0x859911ad6869f49b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232ce expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.226383:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9961b9032e00/0x859911ad6869f4d3 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.226440:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996183be6e00/0x859911ad6869f49b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232ce expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.226455:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996183be6e00/0x859911ad6869f49b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232ce expref: 9 pid: 5846 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075843.226471:0:8460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1873884700763264:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787075843.226587:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996190039000/0x859911ad6869f494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232c7 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.226596:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996190039000/0x859911ad6869f494 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232c7 expref: 9 pid: 5844 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075843.226605:0:8460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1873884700763392:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787075843.226666:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181523400/0x859911ad6869f486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f47f expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.226675:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996181523400/0x859911ad6869f486 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f47f expref: 18 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075843.226684:0:8460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1873884700763520:0@lo:104: 00000100:00100000:2.0:1787075843.226721:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075843.226760:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700763520 00000100:00100000:2.0:1787075843.226767:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700763520 00000100:00100000:2.0:1787075843.226805:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787075843.226814:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:8460:x1873884700763520:12345-0@lo:104: 00010000:00010000:2.0:1787075843.226825:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f47f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f486 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.226868:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787075843.226874:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:8460:x1873884700763520:12345-0@lo:104: Request processed in 61us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075843.226881:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787075843.227122:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787075843.227128:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f47f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f486 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.227137:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523800 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:0.0:1787075843.227146:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f47f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f486 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.227156:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f47f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f486 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787075843.227164:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f47f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f486 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787075843.227170:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787075843.227196:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f47f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f486 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.227202:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787075843.227219:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f47f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f486 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.227226:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181523800/0x859911ad6869f47f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f486 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.227238:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075843.227239:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075843.227241:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075843.227258:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700763648:0@lo:103: 00000100:00100000:0.0:1787075843.227285:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075843.227317:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700763648 00000100:00100000:0.0:1787075843.227320:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700763648 00010000:00010000:0.0:1787075843.227337:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181523400/0x859911ad6869f486 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f47f expref: 19 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075843.227358:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787075843.227373:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1882680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700763648:12345-0@lo:103: 00010000:00010000:0.0:1787075843.227384:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075843.227390:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181523400/0x859911ad6869f486 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f47f expref: 19 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.227399:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181523400/0x859911ad6869f486 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f47f expref: 19 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.227425:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075843.227453:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1882680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700763648:12345-0@lo:103: Request processed in 80us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075843.227460:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787075843.227498:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700763648:0@lo:103: 00010000:00010000:2.0:1787075843.227722:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996190039600/0x859911ad6869f45c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f455 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.227733:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996190039600/0x859911ad6869f45c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f455 expref: 18 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075843.227744:0:8460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1873884700763776:0@lo:104: 00000100:00100000:2.0:1787075843.227773:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787075843.227794:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996183be6400/0x859911ad6869f440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f439 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.227811:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996183be6400/0x859911ad6869f440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f439 expref: 18 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075843.227818:0:8460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1873884700763904:0@lo:104: 00010000:00010000:2.0:1787075843.227846:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181522000/0x859911ad6869f432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f42b expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.227854:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996181522000/0x859911ad6869f432 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f42b expref: 18 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075843.227862:0:8460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1873884700764032:0@lo:104: 00000100:00100000:0.0:1787075843.228037:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787075843.228057:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075843.228076:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075843.228082:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700763776 00000100:00100000:0.0:1787075843.228086:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700763776 00000100:00100000:0.0:1787075843.228105:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700763904 00000100:00100000:0.0:1787075843.228108:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700763904 00000100:00100000:0.0:1787075843.228118:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700764032 00000100:00100000:0.0:1787075843.228120:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700764032 00000100:00100000:0.0:1787075843.228130:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787075843.228136:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf627c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+5:8460:x1873884700763776:12345-0@lo:104: 00010000:00010000:0.0:1787075843.228146:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f45c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228185:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787075843.228190:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf627c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+5:8460:x1873884700763776:12345-0@lo:104: Request processed in 54us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075843.228202:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787075843.228239:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787075843.228245:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+4:8460:x1873884700763904:12345-0@lo:104: 00010000:00010000:0.0:1787075843.228253:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996181497800/0x859911ad6869f439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f440 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228290:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787075843.228295:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+4:8460:x1873884700763904:12345-0@lo:104: Request processed in 52us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075843.228300:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787075843.228310:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787075843.228316:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:8460:x1873884700764032:12345-0@lo:104: 00010000:00010000:0.0:1787075843.228322:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996183be7400/0x859911ad6869f42b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f432 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228345:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787075843.228350:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:8460:x1873884700764032:12345-0@lo:104: Request processed in 35us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075843.228355:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1787075843.228372:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787075843.228376:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f45c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228383:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522200 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:0.0:1787075843.228387:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f45c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228423:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f45c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787075843.228429:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f45c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787075843.228434:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787075843.228457:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f455 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f45c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228463:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787075843.228478:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f455 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f45c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228485:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad6869f455 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f45c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228495:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787075843.228499:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181497800/0x859911ad6869f439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f440 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228504:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181497800 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:0.0:1787075843.228507:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181497800/0x859911ad6869f439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f440 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228513:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181497800/0x859911ad6869f439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f440 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787075843.228519:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181497800/0x859911ad6869f439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f440 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787075843.228530:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787075843.228544:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181497800/0x859911ad6869f439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f440 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228550:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787075843.228556:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181497800/0x859911ad6869f439 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f440 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228562:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181497800/0x859911ad6869f439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f440 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228572:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787075843.228575:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996183be7400/0x859911ad6869f42b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f432 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228580:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996183be7400 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:0.0:1787075843.228583:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996183be7400/0x859911ad6869f42b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f432 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228588:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996183be7400/0x859911ad6869f42b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f432 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787075843.228593:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996183be7400/0x859911ad6869f42b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f432 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787075843.228597:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787075843.228607:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996183be7400/0x859911ad6869f42b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f432 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228611:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787075843.228626:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996183be7400/0x859911ad6869f42b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f432 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228633:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996183be7400/0x859911ad6869f42b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f432 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228671:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075843.228673:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075843.228674:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075843.228685:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700764160:0@lo:103: 00000100:00100000:0.0:1787075843.228713:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075843.228734:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787075843.228740:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700764288:0@lo:103: 00000100:00100000:0.0:1787075843.228759:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075843.228784:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700764160 00000100:00100000:0.0:1787075843.228788:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700764160 00010000:00010000:0.0:1787075843.228802:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996190039600/0x859911ad6869f45c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f455 expref: 19 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075843.228818:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700764288 00000100:00100000:0.0:1787075843.228821:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700764288 00010000:00010000:0.0:1787075843.228829:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996183be6400/0x859911ad6869f440 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f439 expref: 20 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075843.228839:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787075843.228844:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+20:3311:x1873884700764160:12345-0@lo:103: 00010000:00010000:0.0:1787075843.228852:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075843.228857:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996190039600/0x859911ad6869f45c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f455 expref: 20 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228876:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996190039600/0x859911ad6869f45c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f455 expref: 20 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.228899:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075843.229151:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787075843.229163:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700764416:0@lo:103: 00010000:00010000:2.0:1787075843.229250:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181523600/0x859911ad6869f424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f41d expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.229260:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996181523600/0x859911ad6869f424 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f41d expref: 20 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075843.229269:0:8460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1873884700764544:0@lo:104: 00000100:00100000:1.0:1787075843.230060:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787075843.230094:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075843.230119:0:5838:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787075843.230128:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787075843.230143:0:5836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787075843.230150:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700764416 00000100:00100000:1.0:1787075843.230154:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700764416 00010000:00010000:1.0:1787075843.230174:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181522000/0x859911ad6869f432 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f42b expref: 21 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075843.230191:0:5836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787075843.230198:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787075843.230205:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+21:3311:x1873884700764288:12345-0@lo:103: 00010000:00010000:1.0:1787075843.230215:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075843.230220:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996183be6400/0x859911ad6869f440 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f439 expref: 21 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.230245:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996183be6400/0x859911ad6869f440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f439 expref: 21 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.230259:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075843.230290:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+21:3311:x1873884700764288:12345-0@lo:103: Request processed in 85us (1530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075843.230297:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787075843.230313:0:5836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787075843.230319:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787075843.230324:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+20:3314:x1873884700764416:12345-0@lo:103: 00010000:00010000:1.0:1787075843.230331:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075843.230335:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181522000/0x859911ad6869f432 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f42b expref: 20 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.230344:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181522000/0x859911ad6869f432 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f42b expref: 20 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.230353:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075843.230380:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+20:3314:x1873884700764416:12345-0@lo:103: Request processed in 55us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075843.230386:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787075843.230566:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700764416:0@lo:103: 00000100:00100000:1.0:1787075843.230781:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700764288:0@lo:103: 00000100:00100000:1.0:1787075843.230790:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700764160:0@lo:103: 00000100:00100000:0.0:1787075843.231179:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3311:x1873884700764160:12345-0@lo:103: Request processed in 2333us (2464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075843.231188:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787075843.231304:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787075843.231362:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181522a00/0x859911ad6869f3fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f3f3 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.231375:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996181522a00/0x859911ad6869f3fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f3f3 expref: 18 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075843.231387:0:8460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1873884700764672:0@lo:104: 00000100:00100000:0.0:1787075843.231493:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700764544 00000100:00100000:0.0:1787075843.231498:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700764544 00000100:00100000:0.0:1787075843.231540:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787075843.231547:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:8460:x1873884700764544:12345-0@lo:104: 00010000:00010000:0.0:1787075843.231559:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996181522800/0x859911ad6869f41d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f424 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.231603:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787075843.231608:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:8460:x1873884700764544:12345-0@lo:104: Request processed in 62us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075843.231615:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1787075843.231630:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787075843.231636:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181522800/0x859911ad6869f41d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f424 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.231667:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522800 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:0.0:1787075843.231671:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181522800/0x859911ad6869f41d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f424 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.231680:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181522800/0x859911ad6869f41d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f424 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787075843.231702:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181522800/0x859911ad6869f41d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f424 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787075843.231708:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787075843.231732:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181522800/0x859911ad6869f41d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f424 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.231739:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787075843.231757:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181522800/0x859911ad6869f41d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f424 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.231765:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181522800/0x859911ad6869f41d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f424 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.231776:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075843.231778:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075843.231780:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075843.231790:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700764800:0@lo:103: 00000100:00100000:0.0:1787075843.231820:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075843.231848:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700764800 00000100:00100000:0.0:1787075843.231852:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700764800 00010000:00010000:0.0:1787075843.231870:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181523600/0x859911ad6869f424 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f41d expref: 19 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075843.231904:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787075843.231911:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700764800:12345-0@lo:103: 00010000:00010000:0.0:1787075843.231920:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075843.231947:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181523600/0x859911ad6869f424 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f41d expref: 19 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.231965:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181523600/0x859911ad6869f424 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f41d expref: 19 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.231979:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075843.232009:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700764800:12345-0@lo:103: Request processed in 99us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075843.232015:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787075843.232045:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700764800:0@lo:103: 00000100:00100000:2.0:1787075843.232615:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787075843.232689:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996183be6c00/0x859911ad6869f3d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f3c9 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.232706:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996183be6c00/0x859911ad6869f3d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f3c9 expref: 18 pid: 5847 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075843.232716:0:8460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f69f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1873884700764928:0@lo:104: 00000100:00100000:2.0:1787075843.232743:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075843.232754:0:8460:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eebf00 going to sleep for 11 seconds 00010000:00010000:2.0:1787075843.232769:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181523400/0x859911ad6869f486 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f47f expref: 18 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075843.232781:0:8460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1873884700763520:0@lo:104: 00010000:00010000:2.0:1787075843.232793:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996190039600/0x859911ad6869f45c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f455 expref: 17 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075843.232804:0:8460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1873884700763776:0@lo:104: 00010000:00010000:2.0:1787075843.232815:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996183be6400/0x859911ad6869f440 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f439 expref: 16 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075843.232822:0:8460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1873884700763904:0@lo:104: 00010000:00010000:2.0:1787075843.232831:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181522000/0x859911ad6869f432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f42b expref: 15 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075843.232839:0:8460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1873884700764032:0@lo:104: 00010000:00010000:2.0:1787075843.232847:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181523600/0x859911ad6869f424 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f41d expref: 14 pid: 5846 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075843.232855:0:8460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1873884700764544:0@lo:104: 00000100:00100000:1.0:1787075843.233061:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700764672 00000100:00100000:1.0:1787075843.233067:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700764672 00000100:00100000:1.0:1787075843.233100:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700764928 00000100:00100000:1.0:1787075843.233103:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700764928 00000100:00100000:1.0:1787075843.233116:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787075843.233122:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+4:8460:x1873884700764672:12345-0@lo:104: 00010000:00010000:1.0:1787075843.233131:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996183be7600/0x859911ad6869f3f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f3fa expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.233195:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787075843.233201:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+4:8460:x1873884700764672:12345-0@lo:104: Request processed in 79us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075843.233207:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787075843.233223:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787075843.233229:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:8460:x1873884700764928:12345-0@lo:104: 00010000:00010000:1.0:1787075843.233237:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad6869f3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f3d0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.233267:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787075843.233272:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:8460:x1873884700764928:12345-0@lo:104: Request processed in 45us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075843.233278:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787075843.233295:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787075843.233300:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996183be7600/0x859911ad6869f3f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f3fa expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.233308:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996183be7600 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787075843.233312:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996183be7600/0x859911ad6869f3f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f3fa expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.233321:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996183be7600/0x859911ad6869f3f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f3fa expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787075843.233334:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996183be7600/0x859911ad6869f3f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f3fa expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075843.233340:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787075843.233365:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996183be7600/0x859911ad6869f3f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f3fa expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.233371:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787075843.233385:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996183be7600/0x859911ad6869f3f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f3fa expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.233392:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996183be7600/0x859911ad6869f3f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f3fa expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.233426:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787075843.233429:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad6869f3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f3d0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.233434:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522c00 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787075843.233437:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad6869f3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f3d0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.233444:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad6869f3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f3d0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787075843.233451:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad6869f3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f3d0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075843.233456:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787075843.233476:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad6869f3c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f3d0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.233482:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787075843.233488:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad6869f3c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f3d0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.233494:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad6869f3c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f3d0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.233509:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075843.233510:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075843.233512:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075843.233527:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700765056:0@lo:103: 00000100:00100000:1.0:1787075843.233557:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075843.233585:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787075843.233591:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700765184:0@lo:103: 00000100:00100000:1.0:1787075843.233614:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075843.233665:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700765056 00000100:00100000:1.0:1787075843.233670:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700765056 00010000:00010000:1.0:1787075843.233688:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181522a00/0x859911ad6869f3fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f3f3 expref: 14 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075843.233705:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700765184 00000100:00100000:1.0:1787075843.233708:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700765184 00010000:00010000:1.0:1787075843.233720:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996183be6c00/0x859911ad6869f3d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f3c9 expref: 15 pid: 5847 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075843.233735:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787075843.233742:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:3311:x1873884700765056:12345-0@lo:103: 00010000:00010000:1.0:1787075843.233759:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075843.233765:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181522a00/0x859911ad6869f3fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f3f3 expref: 15 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.233774:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181522a00/0x859911ad6869f3fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f3f3 expref: 15 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.233786:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075843.233816:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:3311:x1873884700765056:12345-0@lo:103: Request processed in 74us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075843.233822:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787075843.233849:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700765056:0@lo:103: 00000100:00100000:1.0:1787075843.233868:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787075843.233875:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a03c9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:3311:x1873884700765184:12345-0@lo:103: 00010000:00010000:1.0:1787075843.233882:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075843.233898:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996183be6c00/0x859911ad6869f3d0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f3c9 expref: 14 pid: 5847 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.233906:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996183be6c00/0x859911ad6869f3d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f3c9 expref: 14 pid: 5847 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.233916:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075843.234121:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a03c9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:3311:x1873884700765184:12345-0@lo:103: Request processed in 245us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075843.234128:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787075843.234168:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700765184:0@lo:103: 00010000:00010000:0.0:1787075843.234259:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075843.234365:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181522a00/0x859911ad6869f3fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f3f3 expref: 13 pid: 5844 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075843.234385:0:8460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1873884700764672:0@lo:104: 00010000:00010000:2.0:1787075843.234515:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996183be6c00/0x859911ad6869f3d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f3c9 expref: 12 pid: 5847 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075843.234525:0:8460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f69f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1873884700764928:0@lo:104: 00000100:00100000:1.0:1787075843.235173:0:8460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1873884700763264:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787075843.235197:0:8460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1873884700763392:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787075843.235240:0:8460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9961b9032e00/0x859911ad6869f4d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075843.239046:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075843.239087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075843.239201:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678721664 00000100:00100000:0.0:1787075843.239211:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678721664 00010000:00010000:0.0:1787075843.239251:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996190039000/0x859911ad6869f494 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232c7 expref: 10 pid: 5844 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075843.239290:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678721536 00000100:00100000:0.0:1787075843.239293:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678721536 00010000:00010000:0.0:1787075843.239306:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996183be6e00/0x859911ad6869f49b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232ce expref: 11 pid: 5846 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075843.239326:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:0.0:1787075843.239337:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fbce478-41bc-496b-b8c6-033a0ad89c67+11:2362:x1873884678721664:12345-192.168.204.50@tcp:103: 00010000:00010000:0.0:1787075843.239353:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075843.239360:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996190039000/0x859911ad6869f494 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232c7 expref: 11 pid: 5844 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.239377:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996190039000/0x859911ad6869f494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232c7 expref: 11 pid: 5844 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.239430:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996190039000/0x859911ad6869f494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232c7 expref: 11 pid: 5844 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.239446:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075843.239504:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2362:x1873884678721664:12345-192.168.204.50@tcp:103: Request processed in 168us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075843.239513:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:0.0:1787075843.239532:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:0.0:1787075843.239538:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:2361:x1873884678721536:12345-192.168.204.50@tcp:103: 00010000:00010000:0.0:1787075843.239546:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075843.239551:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996183be6e00/0x859911ad6869f49b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232ce expref: 9 pid: 5846 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.239561:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996183be6e00/0x859911ad6869f49b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232ce expref: 9 pid: 5846 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.239571:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996183be6e00/0x859911ad6869f49b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232ce expref: 9 pid: 5846 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.239582:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9961b9032e00/0x859911ad6869f4d3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.239589:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961b9032e00/0x859911ad6869f4d3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.239604:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9961b9032e00/0x859911ad6869f4d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.239612:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9961b9032e00/0x859911ad6869f4d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.239626:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9961b9032e00/0x859911ad6869f4d3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.239632:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9961b9032e00/0x859911ad6869f4d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.239670:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032e00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787075843.239675:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9961b9032e00/0x859911ad6869f4d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.239683:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9961b9032e00/0x859911ad6869f4d3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.239695:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9961b9032e00/0x859911ad6869f4d3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075843.239706:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075843.239727:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fbce478-41bc-496b-b8c6-033a0ad89c67+8:2361:x1873884678721536:12345-192.168.204.50@tcp:103: Request processed in 189us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075843.239734:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00010000:00010000:1.0:1787075843.239966:0:8460:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9961b9032e00/0x859911ad6869f4d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.239975:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9961b9032e00/0x859911ad6869f4d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.239982:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961b9032e00/0x859911ad6869f4d3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075843.312121:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075843.320726:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678721792 00000100:00100000:1.0:1787075843.320743:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678721792 00000100:00100000:1.0:1787075843.320854:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 130 00000100:00100000:1.0:1787075843.320865:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+8:5602:x1873884678721792:12345-192.168.204.50@tcp:101: 00010000:00010000:1.0:1787075843.322668:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075843.322694:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996190039000/0x859911ad6869f4da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623330 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.322729:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996190039000/0x859911ad6869f4da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623330 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.322740:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996190039000/0x859911ad6869f4da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623330 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075843.322748:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190039000, rc 0) 00000100:00100000:1.0:1787075843.322821:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:5602:x1873884678721792:12345-192.168.204.50@tcp:101: Request processed in 1956us (10709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075843.322837:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 130 00000100:00100000:0.0:1787075843.344098:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075843.344198:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678721920 00000100:00100000:1.0:1787075843.344209:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678721920 00000100:00100000:1.0:1787075843.344260:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 131 00000100:00100000:1.0:1787075843.344270:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:5602:x1873884678721920:12345-192.168.204.50@tcp:501: 00000100:00100000:1.0:1787075843.344600:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:5602:x1873884678721920:12345-192.168.204.50@tcp:501: Request processed in 329us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075843.344609:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 131 00000100:00100000:2.0:1787075843.348095:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075843.348897:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678722048 00000100:00100000:1.0:1787075843.348908:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678722048 00000100:00100000:1.0:1787075843.348973:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 132 00000100:00100000:1.0:1787075843.348983:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:5602:x1873884678722048:12345-192.168.204.50@tcp:503: 00000100:00100000:1.0:1787075843.349222:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:5602:x1873884678722048:12345-192.168.204.50@tcp:503: Request processed in 240us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075843.349231:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 132 00000100:00100000:1.0:1787075843.354559:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075843.354762:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678722176 00000100:00100000:2.0:1787075843.354772:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678722176 00000100:00100000:2.0:1787075843.354823:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 133 00000100:00100000:2.0:1787075843.354832:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:6067:x1873884678722176:12345-192.168.204.50@tcp:502: 00000100:00100000:2.0:1787075843.355684:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:6067:x1873884678722176:12345-192.168.204.50@tcp:502: Request processed in 789us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075843.355785:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 133 00000100:00100000:2.0:1787075843.358751:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075843.358820:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678722304 00000100:00100000:3.0:1787075843.358836:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678722304 00000100:00100000:3.0:1787075843.358925:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 134 00000100:00100000:3.0:1787075843.358937:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:6067:x1873884678722304:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787075843.359518:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:6067:x1873884678722304:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 580us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075843.359530:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 134 00000100:00100000:1.0:1787075843.362844:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075843.363085:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678722432 00000100:00100000:2.0:1787075843.363096:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678722432 00000100:00100000:2.0:1787075843.363302:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 135 00000100:00100000:2.0:1787075843.363316:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:5602:x1873884678722432:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787075843.363336:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075843.363501:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961b9032a00/0x859911ad6869f4e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623337 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.363537:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961b9032a00/0x859911ad6869f4e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623337 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.363635:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961b9032a00/0x859911ad6869f4e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623337 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075843.363683:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032a00, rc 0) 00000100:00100000:2.0:1787075843.363755:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:5602:x1873884678722432:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 441us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075843.363763:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 135 00000100:00100000:0.0:1787075843.368475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075843.368866:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678722560 00000100:00100000:3.0:1787075843.368928:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678722560 00000100:00100000:3.0:1787075843.369052:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 136 00000100:00100000:3.0:1787075843.369066:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:5602:x1873884678722560:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787075843.369580:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:5602:x1873884678722560:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 513us (1120us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787075843.369593:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 136 00000100:00100000:1.0:1787075843.784665:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787075843.784696:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873884700765440:0@lo:400: 00000100:00100000:1.0:1787075843.784773:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075843.784783:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700765568:0@lo:400: 00000100:00100000:2.0:1787075843.784849:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700765440 00000100:00100000:1.0:1787075843.784856:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700765312:0@lo:13: 00000100:00100000:2.0:1787075843.784859:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700765440 00000100:00100000:2.0:1787075843.784910:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787075843.784922:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700765824:0@lo:400: 00000100:00100000:2.0:1787075843.784922:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873884700765440:12345-0@lo:400: 00000100:00100000:0.0:1787075843.786453:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075843.786513:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787075843.786524:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700765696:0@lo:400: 00000100:00100000:0.0:1787075843.786578:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075843.786621:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700765568 00000100:00100000:0.0:1787075843.786656:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700765568 00000100:00100000:0.0:1787075843.786713:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787075843.786722:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700765568:12345-0@lo:400: 00000100:00100000:1.0:1787075843.786771:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075843.786781:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700765568:12345-0@lo:400: Request processed in 59us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075843.786790:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787075843.786816:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700765952:0@lo:400: 00000100:00080000:0.0:1787075843.786818:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787075843.786833:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700765312 00000100:00100000:0.0:1787075843.786837:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700765312 00000100:00100000:0.0:1787075843.786866:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787075843.786872:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700765312:12345-0@lo:13: 00002000:00000024:0.0:1787075843.786902:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075843.786915:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075843.786946:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700765312:12345-0@lo:13: Request processed in 73us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075843.786952:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787075843.786970:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787075843.786999:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700765568:0@lo:400: 00010000:00080000:1.0:1787075843.787025:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961c1880380 x1873884700765312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075843.787051:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700765312:0@lo:13: 00000100:00100000:0.0:1787075843.787052:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700765696 00000100:00100000:0.0:1787075843.787058:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700765696 00000100:00100000:0.0:1787075843.787095:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700765952 00000100:00100000:0.0:1787075843.787099:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700765952 00000100:00080000:1.0:1787075843.787104:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787075843.787117:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787075843.787125:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700765696:12345-0@lo:400: 00000100:00100000:1.0:1787075843.787126:0:6706:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787075843.787138:0:6706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787075843.787168:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700765696:12345-0@lo:400: Request processed in 44us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075843.787175:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787075843.787188:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787075843.787195:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700765952:12345-0@lo:400: 00000100:00100000:0.0:1787075843.787239:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700765952:12345-0@lo:400: Request processed in 44us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075843.787247:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787075843.787276:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f6ad80 x1873884700765952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075843.787287:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700765952:0@lo:400: 00000100:00100000:1.0:1787075843.789054:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873884700765440:0@lo:400: 00010000:00080000:0.0:1787075843.789663:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f69c00 x1873884700765696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075843.789677:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700765696:0@lo:400: 00000100:00100000:2.0:1787075843.790143:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873884700765440:12345-0@lo:400: Request processed in 3979us (4126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075843.790157:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787075843.793257:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075843.793459:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700765824 00000100:00100000:0.0:1787075843.793469:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700765824 00000100:00100000:0.0:1787075843.793551:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787075843.793561:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700765824:12345-0@lo:400: 00000100:00100000:0.0:1787075843.793627:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700765824:12345-0@lo:400: Request processed in 68us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075843.793634:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1787075843.793718:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075843.793821:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700765824:0@lo:400: 00000100:00100000:0.0:1787075843.870091:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075843.870285:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678722816 00000100:00100000:1.0:1787075843.870296:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678722816 00000100:00100000:1.0:1787075843.870374:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:1.0:1787075843.870383:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2360:x1873884678722816:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075843.870476:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2360:x1873884678722816:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 94us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075843.870484:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00080000:0.0:1787075843.870540:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787075843.888677:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075843.888728:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075843.888810:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678722944 00000100:00100000:3.0:1787075843.888821:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678722944 00000100:00100000:3.0:1787075843.888908:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:3.0:1787075843.888918:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2359:x1873884678722944:12345-192.168.204.50@tcp:400:kworker.0 00000100:00080000:0.0:1787075843.889153:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787075843.889351:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2359:x1873884678722944:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 433us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075843.889361:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:1.0:1787075843.889792:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678722688 00000100:00100000:1.0:1787075843.889799:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678722688 00000100:00100000:1.0:1787075843.889851:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:1.0:1787075843.889860:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678722688:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075843.889907:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678722688:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 49us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075843.889915:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00080000:0.0:1787075843.890245:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787075843.979149:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787075844.683846:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787075844.683853:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9961bf681000 from 39 10000000:01000000:2.0:1787075844.683858:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787075844.683903:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033000/0x859911ad6869f4e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075844.683915:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9961b9033000/0x859911ad6869f4e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075844.683927:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9961b9033000/0x859911ad6869f4e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075844.683963:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700766080:0@lo:101: 00000100:00100000:2.0:1787075844.684041:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075844.684095:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eeb300 going to sleep for 11 seconds 00000100:00100000:1.0:1787075844.684209:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700766080 00000100:00100000:1.0:1787075844.684217:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700766080 00000100:00100000:1.0:1787075844.684272:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787075844.684281:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+12:5849:x1873884700766080:12345-0@lo:101: 00010000:00010000:1.0:1787075844.684313:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075844.684337:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996190039e00/0x859911ad6869f4ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f4e8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075844.684362:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996190039e00/0x859911ad6869f4ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f4e8 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075844.684373:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996190039e00/0x859911ad6869f4ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f4e8 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075844.684382:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190039e00, rc 0) 00000100:00100000:1.0:1787075844.684437:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:5849:x1873884700766080:12345-0@lo:101: Request processed in 157us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075844.684445:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787075844.684949:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700766080:0@lo:101: 00010000:00010000:2.0:1787075844.684967:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9961b9033000/0x859911ad6869f4e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f4ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075844.684987:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9961b9033000/0x859911ad6869f4e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f4ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075844.685040:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700766208:0@lo:501: 00000100:00100000:2.0:1787075844.685070:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075844.685098:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eeb300 going to sleep for 11 seconds 00000100:00100000:3.0:1787075844.685148:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700766208 00000100:00100000:3.0:1787075844.685153:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700766208 00000100:00100000:3.0:1787075844.685186:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787075844.685194:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:5849:x1873884700766208:12345-0@lo:501: 00000100:00100000:3.0:1787075844.685466:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:5849:x1873884700766208:12345-0@lo:501: Request processed in 272us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075844.685473:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787075844.685705:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700766208:0@lo:501: 00000100:00100000:2.0:1787075844.685734:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700766336:0@lo:503: 00000100:00100000:2.0:1787075844.685773:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075844.685801:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eeb300 going to sleep for 11 seconds 00000100:00100000:3.0:1787075844.687701:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700766336 00000100:00100000:3.0:1787075844.687713:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700766336 00000100:00100000:3.0:1787075844.687767:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787075844.687777:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:5849:x1873884700766336:12345-0@lo:503: 00000100:00100000:3.0:1787075844.688001:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:5849:x1873884700766336:12345-0@lo:503: Request processed in 225us (2227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075844.688016:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787075844.688079:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700766336:0@lo:503: 00000100:00100000:3.0:1787075844.689658:0:8479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf655180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8479:1873884700766464:0@lo:502: 00000100:00100000:3.0:1787075844.689722:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075844.689764:0:8479:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191860c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787075844.689826:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700766464 00000100:00100000:1.0:1787075844.689833:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700766464 00000100:00100000:1.0:1787075844.689877:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787075844.689886:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:8479:x1873884700766464:12345-0@lo:502: 00000100:00100000:1.0:1787075844.690128:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:8479:x1873884700766464:12345-0@lo:502: Request processed in 243us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075844.690137:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787075844.690280:0:8479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf655180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8479:1873884700766464:0@lo:502: 00000100:00100000:3.0:1787075844.690345:0:8479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf655180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8479:1873884700766592:0@lo:502: 00000100:00100000:3.0:1787075844.690378:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075844.690413:0:8479:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191860c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787075844.690577:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700766592 00000100:00100000:2.0:1787075844.690582:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700766592 00000100:00100000:2.0:1787075844.690614:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787075844.690621:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:8479:x1873884700766592:12345-0@lo:502: 00000100:00100000:2.0:1787075844.690794:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:8479:x1873884700766592:12345-0@lo:502: Request processed in 174us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075844.690801:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787075844.690952:0:8479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf655180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8479:1873884700766592:0@lo:502: 00000040:00080000:3.0:1787075844.690982:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787075844.691203:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787075844.691227:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787075844.691237:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033000/0x859911ad6869f4e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f4ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075844.691247:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961b9033000/0x859911ad6869f4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f4ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787075844.691256:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787075844.691258:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787075844.691261:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787075844.691285:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033a00/0x859911ad6869f4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075844.691292:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9961b9033a00/0x859911ad6869f4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075844.691311:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9961b9033a00/0x859911ad6869f4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075844.691615:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700766720:0@lo:101: 00000100:00100000:2.0:1787075844.691684:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075844.691712:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eeb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787075844.693471:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700766720 00000100:00100000:3.0:1787075844.693483:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700766720 00000100:00100000:3.0:1787075844.693548:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787075844.693558:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+13:5849:x1873884700766720:12345-0@lo:101: 00010000:00010000:3.0:1787075844.693572:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075844.693590:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996183be6000/0x859911ad6869f4fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f4f6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075844.693617:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996183be6000/0x859911ad6869f4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f4f6 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075844.693628:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996183be6000/0x859911ad6869f4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f4f6 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075844.693636:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996183be6000, rc 0) 00000100:00100000:3.0:1787075844.693739:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:5849:x1873884700766720:12345-0@lo:101: Request processed in 182us (2054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075844.693746:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787075844.693924:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700766720:0@lo:101: 00010000:00010000:2.0:1787075844.693945:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9961b9033a00/0x859911ad6869f4f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f4fd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075844.693954:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9961b9033a00/0x859911ad6869f4f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f4fd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075844.694030:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700766848:0@lo:501: 00000100:00100000:2.0:1787075844.694069:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075844.694102:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eeb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787075844.694205:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700766848 00000100:00100000:1.0:1787075844.694210:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700766848 00000100:00100000:1.0:1787075844.694241:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787075844.694248:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:5849:x1873884700766848:12345-0@lo:501: 00000100:00100000:1.0:1787075844.694518:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:5849:x1873884700766848:12345-0@lo:501: Request processed in 269us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075844.694525:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787075844.694824:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700766848:0@lo:501: 00000100:00100000:2.0:1787075844.694855:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700766976:0@lo:503: 00000100:00100000:2.0:1787075844.694894:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075844.694921:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eeb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787075844.696220:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700766976 00000100:00100000:1.0:1787075844.696232:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700766976 00000100:00100000:1.0:1787075844.696282:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787075844.696291:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:5849:x1873884700766976:12345-0@lo:503: 00000100:00100000:1.0:1787075844.696514:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:5849:x1873884700766976:12345-0@lo:503: Request processed in 224us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075844.696522:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787075844.698740:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700766976:0@lo:503: 00000100:00100000:2.0:1787075844.700251:0:8480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f6b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8480:1873884700767104:0@lo:502: 00000100:00100000:2.0:1787075844.700522:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075844.700569:0:8480:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eebe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787075844.701550:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700767104 00000100:00100000:3.0:1787075844.701560:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700767104 00000100:00100000:3.0:1787075844.701609:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787075844.701618:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:8480:x1873884700767104:12345-0@lo:502: 00000100:00100000:3.0:1787075844.701891:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:8480:x1873884700767104:12345-0@lo:502: Request processed in 273us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075844.701899:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787075844.702018:0:8480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f6b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8480:1873884700767104:0@lo:502: 00000020:01000000:0.0:1787075844.702054:0:8480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787075844.702062:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787075844.702064:0:8480:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787075844.702070:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787075844.702102:0:8480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1882680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8480:1873884700767232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787075844.702146:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075844.702178:0:8480:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618771c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787075844.702295:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700767232 00000100:00100000:2.0:1787075844.702310:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700767232 00000100:00100000:2.0:1787075844.702478:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787075844.702487:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:8480:x1873884700767232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787075844.702613:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:8480:x1873884700767232:12345-0@lo:502:llog_process_th.0 Request processed in 127us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075844.702620:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787075844.704123:0:8480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1882680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8480:1873884700767232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787075844.704162:0:8480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787075844.704169:0:8480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787075844.704171:0:8480:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787075844.704175:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787075844.705455:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787075844.705480:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787075844.705492:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033a00/0x859911ad6869f4f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f4fd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075844.705505:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961b9033a00/0x859911ad6869f4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f4fd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787075844.705515:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787075844.705518:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9961c14da000 from 39 10000000:01000000:3.0:1787075844.705521:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787075844.705554:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075844.705563:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075844.705573:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075844.705614:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf655180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700767360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787075844.705702:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075844.705756:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191332180 going to sleep for 11 seconds 00000100:00100000:2.0:1787075844.705815:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700767360 00000100:00100000:2.0:1787075844.705821:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700767360 00000100:00100000:2.0:1787075844.705868:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787075844.705876:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:5849:x1873884700767360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787075844.705888:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075844.705900:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961b9032200/0x859911ad6869f50b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f504 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075844.705923:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961b9032200/0x859911ad6869f50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f504 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075844.705939:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961b9032200/0x859911ad6869f50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f504 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075844.705948:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032200, rc 0) 00000100:00100000:2.0:1787075844.706003:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700767360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075844.706011:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787075844.706212:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf655180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700767360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787075844.706227:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f50b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075844.706236:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f50b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075844.706285:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700767488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787075844.706312:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075844.706347:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618771c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787075844.706752:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700767488 00000100:00100000:2.0:1787075844.706757:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700767488 00000100:00100000:2.0:1787075844.706788:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787075844.706795:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700767488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787075844.707065:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700767488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075844.707072:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787075844.708129:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700767488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787075844.708177:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700767616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787075844.708235:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075844.708263:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618771c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787075844.708761:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700767616 00000100:00100000:2.0:1787075844.708769:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700767616 00000100:00100000:2.0:1787075844.708808:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787075844.708817:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700767616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075844.709156:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700767616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 339us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075844.709163:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787075844.709250:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700767616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787075844.709907:0:8481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf656300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8481:1873884700767744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787075844.709956:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075844.710000:0:8481:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187940180 going to sleep for 11 seconds 00000100:00100000:0.0:1787075844.710355:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700767744 00000100:00100000:0.0:1787075844.710362:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700767744 00000100:00100000:0.0:1787075844.710412:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787075844.710421:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:8481:x1873884700767744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787075844.710629:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:8481:x1873884700767744:12345-0@lo:502:llog_process_th.0 Request processed in 209us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075844.710674:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787075844.711204:0:8481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf656300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8481:1873884700767744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787075844.711315:0:8481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf656300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8481:1873884700767872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787075844.711403:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075844.711455:0:8481:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187940180 going to sleep for 11 seconds 00000100:00100000:2.0:1787075844.711689:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700767872 00000100:00100000:2.0:1787075844.711699:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700767872 00000100:00100000:2.0:1787075844.711763:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787075844.711774:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:8481:x1873884700767872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787075844.712233:0:8481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf656300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8481:1873884700767872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787075844.712236:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:8481:x1873884700767872:12345-0@lo:502:llog_process_th.0 Request processed in 461us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075844.712257:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000040:00080000:3.0:1787075844.712274:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787075844.712911:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787075844.712943:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787075844.712952:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f50b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075844.712965:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f50b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787075844.712987:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787075844.712989:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787075844.712992:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787075844.713023:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181497e00/0x859911ad6869f512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075844.713031:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996181497e00/0x859911ad6869f512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075844.713039:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181497e00/0x859911ad6869f512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075844.713060:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1883b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700768000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787075844.713106:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075844.713148:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618771c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787075844.713167:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700768000 00000100:00100000:3.0:1787075844.713177:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700768000 00000100:00100000:3.0:1787075844.713223:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787075844.713232:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:5849:x1873884700768000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787075844.713247:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075844.713267:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996183be6a00/0x859911ad6869f519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f512 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075844.713300:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996183be6a00/0x859911ad6869f519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f512 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075844.713331:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996183be6a00/0x859911ad6869f519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f512 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075844.713341:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996183be6a00, rc 0) 00000100:00100000:3.0:1787075844.713421:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:5849:x1873884700768000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075844.713428:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787075844.714105:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1883b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700768000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787075844.714126:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181497e00/0x859911ad6869f512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f519 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075844.714157:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181497e00/0x859911ad6869f512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f519 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075844.714219:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1883b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700768128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787075844.714258:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075844.714297:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618771c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787075844.714430:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700768128 00000100:00100000:1.0:1787075844.714437:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700768128 00000100:00100000:1.0:1787075844.714480:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787075844.714489:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:5849:x1873884700768128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787075844.714760:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:5849:x1873884700768128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075844.714767:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787075844.715123:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1883b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700768128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787075844.715155:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1883b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700768256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787075844.715191:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075844.715219:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618771c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787075844.715446:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700768256 00000100:00100000:2.0:1787075844.715452:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700768256 00000100:00100000:2.0:1787075844.715474:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787075844.715481:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:5849:x1873884700768256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075844.715633:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:5849:x1873884700768256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075844.715668:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787075844.716706:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1883b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700768256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787075844.717998:0:8482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8482:1873884700768384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787075844.718068:0:8482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075844.718111:0:8482:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187939c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787075844.718242:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700768384 00000100:00100000:2.0:1787075844.718250:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700768384 00000100:00100000:2.0:1787075844.718292:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787075844.718312:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:8482:x1873884700768384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787075844.718584:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:8482:x1873884700768384:12345-0@lo:502:llog_process_th.0 Request processed in 284us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075844.718592:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787075844.718682:0:8482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8482:1873884700768384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787075844.718715:0:8482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787075844.718725:0:8482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787075844.718728:0:8482:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787075844.718734:0:8482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787075844.718771:0:8482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f68700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8482:1873884700768512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787075844.718813:0:8482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075844.718833:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700768512 00000100:00100000:2.0:1787075844.718837:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700768512 00000100:00100000:2.0:1787075844.718860:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787075844.718868:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:8482:x1873884700768512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787075844.721050:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:8482:x1873884700768512:12345-0@lo:502:llog_process_th.0 Request processed in 2174us (2227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075844.721064:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787075844.721131:0:8482:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eeb480 going to sleep for 11 seconds 00000100:00100000:2.0:1787075844.721155:0:8482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f68700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8482:1873884700768512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787075844.721190:0:8482:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787075844.721198:0:8482:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787075844.721200:0:8482:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787075844.721204:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787075844.729983:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787075844.730031:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787075844.730044:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181497e00/0x859911ad6869f512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f519 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075844.730059:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181497e00/0x859911ad6869f512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f519 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075844.730070:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787075844.730074:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9961a03a5800 from 39 10000000:01000000:1.0:1787075844.730077:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787075844.730139:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190039800/0x859911ad6869f520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075844.730149:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996190039800/0x859911ad6869f520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075844.730160:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996190039800/0x859911ad6869f520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075844.730187:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700768640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787075844.730263:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075844.730343:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187971f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787075844.730848:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700768640 00000100:00100000:3.0:1787075844.730863:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700768640 00000100:00100000:3.0:1787075844.730931:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787075844.730943:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:5849:x1873884700768640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787075844.730963:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075844.730983:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996183be7c00/0x859911ad6869f527 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f520 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075844.731026:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996183be7c00/0x859911ad6869f527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f520 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075844.731040:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996183be7c00/0x859911ad6869f527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f520 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075844.731052:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996183be7c00, rc 0) 00000100:00100000:3.0:1787075844.731147:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700768640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075844.731157:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787075844.731196:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700768640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787075844.731220:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996190039800/0x859911ad6869f520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f527 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075844.731231:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996190039800/0x859911ad6869f520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f527 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075844.731314:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700768768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787075844.731365:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075844.731403:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187971f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787075844.731509:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700768768 00000100:00100000:3.0:1787075844.731516:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700768768 00000100:00100000:3.0:1787075844.731631:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787075844.731655:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700768768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787075844.731987:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700768768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 348us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075844.732615:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787075844.732886:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700768768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787075844.732942:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700768896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787075844.733025:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075844.733061:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187971f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787075844.734036:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700768896 00000100:00100000:3.0:1787075844.734051:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700768896 00000100:00100000:3.0:1787075844.734124:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787075844.734136:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700768896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787075844.734476:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700768896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 340us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075844.734486:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787075844.734630:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700768896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787075844.736246:0:8484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf656300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8484:1873884700769024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787075844.736414:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075844.736466:0:8484:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961a0395a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787075844.737213:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700769024 00000100:00100000:1.0:1787075844.737237:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700769024 00000100:00100000:1.0:1787075844.737296:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787075844.737318:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:8484:x1873884700769024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787075844.737628:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:8484:x1873884700769024:12345-0@lo:502:llog_process_th.0 Request processed in 311us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075844.737636:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787075844.738150:0:8484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf656300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8484:1873884700769024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787075844.738223:0:8484:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1883b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8484:1873884700769152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787075844.738272:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075844.738322:0:8484:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618771c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787075844.738592:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700769152 00000100:00100000:2.0:1787075844.738598:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700769152 00000100:00100000:2.0:1787075844.738628:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787075844.738655:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:8484:x1873884700769152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787075844.738839:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:8484:x1873884700769152:12345-0@lo:502:llog_process_th.0 Request processed in 203us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075844.738846:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787075844.739056:0:8484:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1883b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8484:1873884700769152:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787075844.739082:0:8484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787075844.739237:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787075844.739257:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787075844.739267:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190039800/0x859911ad6869f520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f527 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075844.739279:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996190039800/0x859911ad6869f520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f527 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075844.739289:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787075844.739292:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787075844.739295:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787075844.739341:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f52e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075844.739350:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f52e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075844.739359:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f52e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075844.739376:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700769280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787075844.739419:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075844.739449:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996183ee2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787075844.739599:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700769280 00000100:00100000:2.0:1787075844.739605:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700769280 00000100:00100000:2.0:1787075844.739719:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787075844.739727:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700769280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787075844.739736:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075844.739760:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961b9033800/0x859911ad6869f535 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f52e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075844.739785:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961b9033800/0x859911ad6869f535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f52e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075844.739809:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961b9033800/0x859911ad6869f535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f52e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075844.739819:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9033800, rc 0) 00000100:00100000:2.0:1787075844.739861:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700769280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075844.739870:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787075844.740189:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700769280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787075844.740205:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f52e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f535 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075844.740228:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f52e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f535 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075844.740283:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1883b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700769408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787075844.740435:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075844.740465:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618771c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787075844.740532:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700769408 00000100:00100000:1.0:1787075844.740538:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700769408 00000100:00100000:1.0:1787075844.740573:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787075844.740580:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700769408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787075844.740937:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700769408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 357us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075844.740945:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787075844.741070:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1883b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700769408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787075844.741103:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1883b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700769536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787075844.741149:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075844.741168:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618771c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787075844.741263:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700769536 00000100:00100000:2.0:1787075844.741268:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700769536 00000100:00100000:2.0:1787075844.741294:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787075844.741316:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700769536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075844.741701:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700769536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 386us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075844.741709:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787075844.746340:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1883b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700769536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075844.750087:0:8486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f68700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8486:1873884700769664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787075844.750180:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075844.750231:0:8486:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eeb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075844.750556:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700769664 00000100:00100000:0.0:1787075844.750564:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700769664 00000100:00100000:0.0:1787075844.750614:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787075844.750624:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:8486:x1873884700769664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787075844.750917:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:8486:x1873884700769664:12345-0@lo:502:llog_process_th.0 Request processed in 293us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075844.750925:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787075844.751072:0:8486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f68700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8486:1873884700769664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787075844.751110:0:8486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787075844.751119:0:8486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787075844.751121:0:8486:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787075844.751127:0:8486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787075844.751150:0:8486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8486:1873884700769792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787075844.751190:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075844.751219:0:8486:0:(client.c:2702:ptlrpc_set_wait()) set ffff996183ee2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787075844.751293:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700769792 00000100:00100000:2.0:1787075844.751308:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700769792 00000100:00100000:2.0:1787075844.751338:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787075844.751355:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:8486:x1873884700769792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787075844.751498:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:8486:x1873884700769792:12345-0@lo:502:llog_process_th.0 Request processed in 151us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075844.751505:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787075844.751677:0:8486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8486:1873884700769792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787075844.751698:0:8486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787075844.751702:0:8486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787075844.751704:0:8486:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787075844.751707:0:8486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787075844.752946:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787075844.752988:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787075844.752999:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f52e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f535 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075844.753010:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f535 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787075844.753021:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787075844.753024:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9961b009b380 from 1 10000000:01000000:2.0:1787075844.753027:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787075844.753057:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033e00/0x859911ad6869f53c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075844.753065:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9961b9033e00/0x859911ad6869f53c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075844.753075:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9961b9033e00/0x859911ad6869f53c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075844.753094:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700769920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787075844.753152:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075844.753182:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187939900 going to sleep for 11 seconds 00000100:00100000:0.0:1787075844.754116:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700769920 00000100:00100000:0.0:1787075844.754126:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700769920 00000100:00100000:0.0:1787075844.754178:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787075844.754186:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700769920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787075844.754199:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075844.754214:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181496a00/0x859911ad6869f543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f53c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075844.754267:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181496a00/0x859911ad6869f543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f53c expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075844.754277:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181496a00/0x859911ad6869f543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f53c expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075844.754286:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181496a00, rc 0) 00000100:00100000:0.0:1787075844.754338:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700769920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075844.754345:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787075844.754407:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700769920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787075844.754422:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9961b9033e00/0x859911ad6869f53c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f543 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075844.754431:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9961b9033e00/0x859911ad6869f53c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f543 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075844.754490:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1881f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700770048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787075844.754524:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075844.754556:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618771c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787075844.754720:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700770048 00000100:00100000:1.0:1787075844.754726:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700770048 00000100:00100000:1.0:1787075844.754762:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787075844.754770:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700770048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787075844.755025:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700770048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (499us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787075844.755040:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787075844.755605:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1881f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700770048:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787075844.755675:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787075844.755683:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033e00/0x859911ad6869f53c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f543 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075844.755692:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961b9033e00/0x859911ad6869f53c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f543 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075844.819146:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700770176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787075844.819222:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075844.819322:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700770176 00000100:00100000:1.0:1787075844.819341:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700770176 00000100:00100000:1.0:1787075844.819417:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787075844.819427:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700770176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787075844.819462:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075844.830793:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700770176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11355us (11558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075844.830810:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787075844.831452:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f6bb80 x1873884700770176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075844.831479:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700770176:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787075845.011895:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787075845.391716:0:8520:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff77a93020 20000000:00000080:2.0:1787075845.391740:0:8520:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9961bfd5c000 uarg=0000000000000000 20000000:01000000:2.0:1787075845.391780:0:8520:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787075845.391787:0:8520:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787075845.391792:0:8520:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787075845.397036:0:8521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787075845.397229:0:8520:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787075845.402211:0:8520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1787075845.402270:0:8520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1787075845.402412:0:8520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1787075845.402430:0:8520:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787075845.402452:0:8520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996183be6e00/0x859911ad6869f54a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075845.402472:0:8520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996183be7800/0x859911ad6869f2bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f2b8 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075845.402480:0:8520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181523a00/0x859911ad6869f321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f31a expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075845.402498:0:8520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181497400/0x859911ad6869f3ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f3e5 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075845.402508:0:8520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181497600/0x859911ad6869f4a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232ff expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075845.402584:0:8520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996183be6e00/0x859911ad6869f54a lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075845.402625:0:8520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181497600/0x859911ad6869f4a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232ff expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075845.402785:0:8520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996181497600/0x859911ad6869f4a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232ff expref: 9 pid: 5846 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075845.402803:0:8520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf654380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1873884700770304:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075845.402953:0:8520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181497400/0x859911ad6869f3ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f3e5 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075845.402970:0:8520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996181497400/0x859911ad6869f3ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f3e5 expref: 18 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075845.402980:0:8520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf657100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1873884700770432:0@lo:104: 00000100:00100000:3.0:1787075845.403019:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787075845.403050:0:8520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181523a00/0x859911ad6869f321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f31a expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075845.403057:0:8520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996181523a00/0x859911ad6869f321 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f31a expref: 18 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075845.403078:0:8520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf656a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1873884700770560:0@lo:104: 00000100:00100000:3.0:1787075845.403101:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787075845.403130:0:8520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996183be7800/0x859911ad6869f2bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f2b8 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075845.403138:0:8520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996183be7800/0x859911ad6869f2bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f2b8 expref: 18 pid: 5846 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075845.403146:0:8520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf657b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1873884700770688:0@lo:104: 00000100:00100000:3.0:1787075845.403160:0:8520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bec05600 going to sleep for 11 seconds 00000100:00100000:1.0:1787075845.403235:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787075845.403254:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075845.403265:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700770432 00000100:00100000:1.0:1787075845.403271:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700770432 00000100:00100000:1.0:1787075845.403306:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700770560 00000100:00100000:1.0:1787075845.403309:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700770560 00000100:00100000:1.0:1787075845.403332:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700770688 00000100:00100000:1.0:1787075845.403335:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700770688 00000100:00100000:1.0:1787075845.403349:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787075845.403358:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf654700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+5:8520:x1873884700770432:12345-0@lo:104: 00010000:00010000:1.0:1787075845.403381:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad6869f3e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f3ec expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.403445:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787075845.403452:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf654700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+5:8520:x1873884700770432:12345-0@lo:104: Request processed in 95us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075845.403459:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787075845.403478:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787075845.403484:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b5172050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+4:8520:x1873884700770560:12345-0@lo:104: 00010000:00010000:1.0:1787075845.403498:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996190038400/0x859911ad6869f31a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f321 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.403548:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787075845.403553:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b5172050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+4:8520:x1873884700770560:12345-0@lo:104: Request processed in 70us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075845.403559:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787075845.403594:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787075845.403600:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:8520:x1873884700770688:12345-0@lo:104: 00010000:00010000:1.0:1787075845.403607:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996181496c00/0x859911ad6869f2b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f2bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.403633:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787075845.403663:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:8520:x1873884700770688:12345-0@lo:104: Request processed in 38us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075845.403669:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787075845.403685:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787075845.403690:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad6869f3e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f3ec expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.403698:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523c00 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787075845.403702:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad6869f3e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f3ec expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.403711:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad6869f3e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f3ec expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787075845.403718:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad6869f3e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f3ec expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075845.403730:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787075845.403761:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad6869f3e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f3ec expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.403768:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787075845.403787:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad6869f3e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f3ec expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.403794:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad6869f3e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f3ec expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.403807:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787075845.403810:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996190038400/0x859911ad6869f31a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f321 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.403815:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038400 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787075845.403818:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996190038400/0x859911ad6869f31a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f321 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.403825:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996190038400/0x859911ad6869f31a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f321 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787075845.403831:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996190038400/0x859911ad6869f31a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f321 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075845.403836:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787075845.403847:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996190038400/0x859911ad6869f31a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f321 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.403853:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787075845.403874:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996190038400/0x859911ad6869f31a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f321 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.403880:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996190038400/0x859911ad6869f31a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f321 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.403889:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787075845.403892:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181496c00/0x859911ad6869f2b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f2bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.403897:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181496c00 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787075845.403900:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181496c00/0x859911ad6869f2b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f2bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.403906:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181496c00/0x859911ad6869f2b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f2bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787075845.403912:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181496c00/0x859911ad6869f2b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f2bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075845.403917:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787075845.403930:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181496c00/0x859911ad6869f2b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f2bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.403935:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787075845.403940:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181496c00/0x859911ad6869f2b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f2bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.403947:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181496c00/0x859911ad6869f2b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f2bf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.403960:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075845.403967:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075845.403969:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075845.403975:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075845.403986:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700770816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787075845.404016:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075845.404046:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700770944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787075845.404069:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075845.404086:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787075845.404091:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700771072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787075845.404108:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075845.404133:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700770816 00000100:00100000:1.0:1787075845.404137:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700770816 00010000:00010000:1.0:1787075845.404156:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181497400/0x859911ad6869f3ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f3e5 expref: 19 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075845.404179:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700770944 00000100:00100000:1.0:1787075845.404182:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700770944 00010000:00010000:1.0:1787075845.404194:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181523a00/0x859911ad6869f321 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f31a expref: 20 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075845.404203:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700771072 00000100:00100000:1.0:1787075845.404205:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700771072 00010000:00010000:1.0:1787075845.404214:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996183be7800/0x859911ad6869f2bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f2b8 expref: 21 pid: 5846 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075845.404225:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787075845.404232:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+21:3312:x1873884700770816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787075845.404243:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075845.404249:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181497400/0x859911ad6869f3ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f3e5 expref: 21 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.404264:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181497400/0x859911ad6869f3ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f3e5 expref: 21 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.404279:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075845.404307:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+21:3312:x1873884700770816:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075845.404314:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787075845.404327:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787075845.404333:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+20:3313:x1873884700770944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787075845.404340:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075845.404345:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181523a00/0x859911ad6869f321 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f31a expref: 20 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.404356:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181523a00/0x859911ad6869f321 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f31a expref: 20 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.404366:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075845.404402:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+20:3313:x1873884700770944:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075845.404408:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787075845.404419:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787075845.404425:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700771072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787075845.404433:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075845.404436:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996183be7800/0x859911ad6869f2bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f2b8 expref: 19 pid: 5846 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.404443:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996183be7800/0x859911ad6869f2bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f2b8 expref: 19 pid: 5846 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.404457:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075845.404480:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700771072:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075845.404486:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787075845.404525:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700770816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787075845.404550:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700771072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787075845.404557:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700770944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787075845.405113:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181497400/0x859911ad6869f3ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f3e5 expref: 18 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075845.405127:0:8520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf657100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1873884700770432:0@lo:104: 00010000:00010000:3.0:1787075845.405135:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181523a00/0x859911ad6869f321 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f31a expref: 17 pid: 5844 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075845.405142:0:8520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf656a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1873884700770560:0@lo:104: 00010000:00010000:3.0:1787075845.405151:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996183be7800/0x859911ad6869f2bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f2b8 expref: 16 pid: 5846 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075845.405157:0:8520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf657b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1873884700770688:0@lo:104: 00000100:00100000:3.0:1787075845.408466:0:8520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf654380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1873884700770304:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075845.408507:0:8520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996183be6e00/0x859911ad6869f54a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075845.411368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075845.411472:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678723072 00000100:00100000:1.0:1787075845.411482:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678723072 00010000:00010000:1.0:1787075845.411539:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181497600/0x859911ad6869f4a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232ff expref: 10 pid: 5846 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075845.411588:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:1.0:1787075845.411598:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf654380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2362:x1873884678723072:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787075845.411614:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075845.411620:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181497600/0x859911ad6869f4a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232ff expref: 10 pid: 5846 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.411633:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181497600/0x859911ad6869f4a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232ff expref: 10 pid: 5846 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.411694:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181497600/0x859911ad6869f4a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232ff expref: 10 pid: 5846 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.411713:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996183be6e00/0x859911ad6869f54a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.411732:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996183be6e00/0x859911ad6869f54a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.411751:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996183be6e00/0x859911ad6869f54a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.411758:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996183be6e00/0x859911ad6869f54a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.411765:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996183be6e00/0x859911ad6869f54a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.411772:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996183be6e00/0x859911ad6869f54a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.411778:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996183be6e00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787075845.411782:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996183be6e00/0x859911ad6869f54a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.411790:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996183be6e00/0x859911ad6869f54a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.411807:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996183be6e00/0x859911ad6869f54a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075845.411818:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075845.411869:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf654380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:2362:x1873884678723072:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 272us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075845.411886:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 24 00010000:00010000:0.0:1787075845.411969:0:8520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996183be6e00/0x859911ad6869f54a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075845.411978:0:8520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996183be6e00/0x859911ad6869f54a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075845.411984:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996183be6e00/0x859911ad6869f54a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075846.023907:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075846.493711:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075846.493753:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678723200 00000100:00100000:1.0:1787075846.493763:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678723200 00000100:00100000:1.0:1787075846.493816:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 169 00000100:00100000:1.0:1787075846.493828:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191063850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:5602:x1873884678723200:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787075846.493847:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075846.493870:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996190038e00/0x859911ad6869f551 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762333e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075846.493901:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996190038e00/0x859911ad6869f551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762333e expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075846.493913:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996190038e00/0x859911ad6869f551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762333e expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075846.493924:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190038e00, rc 0) 00000100:00100000:1.0:1787075846.493983:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191063850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:5602:x1873884678723200:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 158us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075846.493991:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 169 00000100:00100000:3.0:1787075846.502117:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075846.506283:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678723328 00000100:00100000:0.0:1787075846.506300:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678723328 00000100:00100000:0.0:1787075846.506379:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 170 00000100:00100000:0.0:1787075846.506391:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:5602:x1873884678723328:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787075846.506759:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:5602:x1873884678723328:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 368us (4649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075846.506769:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 170 00000100:00100000:0.0:1787075846.527609:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075846.528030:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678723456 00000100:00100000:3.0:1787075846.528040:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678723456 00000100:00100000:3.0:1787075846.528103:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 171 00000100:00100000:3.0:1787075846.528113:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:5602:x1873884678723456:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787075846.528329:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:5602:x1873884678723456:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 217us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075846.528338:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 171 00000100:00100000:3.0:1787075846.532235:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075846.533109:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678723584 00000100:00100000:0.0:1787075846.533123:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678723584 00000100:00100000:0.0:1787075846.533200:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 172 00000100:00100000:0.0:1787075846.533212:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:6124:x1873884678723584:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787075846.533532:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:6124:x1873884678723584:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 319us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075846.533543:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 172 00000100:00100000:3.0:1787075846.539164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075846.542827:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678723712 00000100:00100000:1.0:1787075846.542856:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678723712 00000100:00100000:1.0:1787075846.542917:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 173 00000100:00100000:1.0:1787075846.542929:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191062450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:6124:x1873884678723712:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787075846.543225:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191062450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:6124:x1873884678723712:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 298us (4076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075846.543234:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 173 10000000:01000000:1.0:1787075846.600206:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787075846.600233:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9961bf681000 from 4 10000000:01000000:1.0:1787075846.600238:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787075846.600304:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190038c00/0x859911ad6869f558 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075846.600317:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996190038c00/0x859911ad6869f558 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075846.600332:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996190038c00/0x859911ad6869f558 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075846.600379:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700771200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787075846.600479:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075846.600560:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184e79840 going to sleep for 11 seconds 00000100:00100000:0.0:1787075846.600618:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700771200 00000100:00100000:0.0:1787075846.600633:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700771200 00000100:00100000:0.0:1787075846.600728:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787075846.600741:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:5849:x1873884700771200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787075846.600759:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075846.600781:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181496200/0x859911ad6869f55f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f558 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075846.600811:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181496200/0x859911ad6869f55f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f558 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075846.600823:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181496200/0x859911ad6869f55f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f558 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075846.600833:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181496200, rc 0) 00000100:00100000:0.0:1787075846.600907:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700771200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075846.600915:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787075846.601040:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700771200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787075846.601060:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996190038c00/0x859911ad6869f558 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f55f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075846.601071:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996190038c00/0x859911ad6869f558 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f55f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075846.601148:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf657b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700771328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787075846.601186:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075846.601221:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bec05900 going to sleep for 11 seconds 00000100:00100000:0.0:1787075846.601281:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700771328 00000100:00100000:0.0:1787075846.601286:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700771328 00000100:00100000:0.0:1787075846.601439:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787075846.601451:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700771328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787075846.601793:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700771328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 344us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075846.601800:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787075846.602168:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf657b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700771328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787075846.602228:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f68000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700771456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075846.602306:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075846.602336:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187939900 going to sleep for 11 seconds 00000100:00100000:1.0:1787075846.603217:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700771456 00000100:00100000:1.0:1787075846.603230:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700771456 00000100:00100000:1.0:1787075846.603278:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787075846.603287:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191060850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700771456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787075846.603625:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191060850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700771456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 338us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075846.603634:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787075846.608590:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f68000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700771456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787075846.609211:0:8552:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf656a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8552:1873884700771584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787075846.609308:0:8552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075846.609467:0:8552:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bec059c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787075846.611836:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700771584 00000100:00100000:1.0:1787075846.611851:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700771584 00000100:00100000:1.0:1787075846.611907:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787075846.611917:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:8552:x1873884700771584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787075846.612189:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:8552:x1873884700771584:12345-0@lo:502:llog_process_th.0 Request processed in 272us (2879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075846.612197:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787075846.612504:0:8552:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf656a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8552:1873884700771584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787075846.612543:0:8552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787075846.612552:0:8552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787075846.612554:0:8552:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787075846.612565:0:8552:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9961bf681000 00000020:00000080:2.0:1787075846.612567:0:8552:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787075846.612691:0:8552:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f68000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8552:1873884700771712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787075846.612735:0:8552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075846.612773:0:8552:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187939900 going to sleep for 11 seconds 00000100:00100000:0.0:1787075846.612823:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700771712 00000100:00100000:0.0:1787075846.612828:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700771712 00000100:00100000:0.0:1787075846.612867:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787075846.612875:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:8552:x1873884700771712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787075846.613016:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:8552:x1873884700771712:12345-0@lo:502:llog_process_th.0 Request processed in 142us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075846.613023:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787075846.613147:0:8552:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f68000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8552:1873884700771712:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787075846.613168:0:8552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787075846.613173:0:8552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787075846.613180:0:8552:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787075846.613184:0:8552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787075846.613424:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787075846.613444:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787075846.613453:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190038c00/0x859911ad6869f558 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f55f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075846.613465:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996190038c00/0x859911ad6869f558 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f55f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787075846.613476:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787075846.613479:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9961c14da000 from 4 10000000:01000000:0.0:1787075846.613481:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787075846.613505:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f566 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075846.613513:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f566 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075846.613522:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f566 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075846.613547:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700771840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787075846.613575:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075846.613597:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700771840 00000100:00100000:0.0:1787075846.613601:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700771840 00000100:00100000:0.0:1787075846.613624:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787075846.613630:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700771840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787075846.613664:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075846.613678:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181497400/0x859911ad6869f56d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f566 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075846.613699:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181497400/0x859911ad6869f56d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f566 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075846.613710:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181497400/0x859911ad6869f56d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f566 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075846.613718:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181497400, rc 0) 00000100:00100000:0.0:1787075846.613742:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700771840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075846.613748:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787075846.613778:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961a0395780 going to sleep for 11 seconds 00000100:00100000:0.0:1787075846.613791:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700771840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787075846.613803:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f566 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f56d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075846.613812:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f566 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f56d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075846.613861:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700771968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787075846.613886:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075846.613906:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700771968 00000100:00100000:0.0:1787075846.613909:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700771968 00000100:00100000:0.0:1787075846.613931:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787075846.613937:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700771968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787075846.614138:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700771968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075846.614145:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787075846.614166:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961a0395780 going to sleep for 11 seconds 00000100:00100000:0.0:1787075846.614177:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700771968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787075846.614201:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700772096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787075846.614233:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075846.614250:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700772096 00000100:00100000:0.0:1787075846.614254:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700772096 00000100:00100000:0.0:1787075846.614290:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787075846.614297:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700772096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787075846.614573:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700772096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 276us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075846.614580:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787075846.614616:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961a0395780 going to sleep for 11 seconds 00000100:00100000:0.0:1787075846.614630:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700772096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787075846.628603:0:8553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf657100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8553:1873884700772224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787075846.628706:0:8553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075846.628756:0:8553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bec05780 going to sleep for 11 seconds 00000100:00100000:2.0:1787075846.629064:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700772224 00000100:00100000:2.0:1787075846.629071:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700772224 00000100:00100000:2.0:1787075846.629125:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787075846.629135:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:8553:x1873884700772224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787075846.629470:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:8553:x1873884700772224:12345-0@lo:502:llog_process_th.0 Request processed in 336us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075846.629478:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787075846.629864:0:8553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf657100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8553:1873884700772224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787075846.629896:0:8553:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787075846.629906:0:8553:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787075846.629908:0:8553:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787075846.629915:0:8553:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9961c14da000 00000020:00000080:3.0:1787075846.629918:0:8553:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787075846.629991:0:8553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf657100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8553:1873884700772352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787075846.630029:0:8553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075846.630050:0:8553:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bec05780 going to sleep for 11 seconds 00000100:00100000:1.0:1787075846.630278:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700772352 00000100:00100000:1.0:1787075846.630291:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700772352 00000100:00100000:1.0:1787075846.630432:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787075846.630442:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:8553:x1873884700772352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787075846.630580:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:8553:x1873884700772352:12345-0@lo:502:llog_process_th.0 Request processed in 140us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075846.630587:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787075846.631294:0:8553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf657100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8553:1873884700772352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787075846.631708:0:8553:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787075846.631715:0:8553:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787075846.631717:0:8553:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787075846.631721:0:8553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787075846.631898:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787075846.631917:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787075846.631927:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f566 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f56d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075846.631937:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f56d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075846.631947:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787075846.631950:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9961a03a5800 from 4 10000000:01000000:1.0:1787075846.631952:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787075846.631978:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190038000/0x859911ad6869f574 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075846.631986:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996190038000/0x859911ad6869f574 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075846.631996:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996190038000/0x859911ad6869f574 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075846.632014:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700772480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787075846.632052:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075846.632076:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961912ccc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787075846.632206:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700772480 00000100:00100000:2.0:1787075846.632212:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700772480 00000100:00100000:2.0:1787075846.632252:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787075846.632260:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700772480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787075846.632423:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075846.632437:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961b9033400/0x859911ad6869f57b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f574 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075846.632471:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961b9033400/0x859911ad6869f57b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f574 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075846.632482:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961b9033400/0x859911ad6869f57b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f574 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075846.632491:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9033400, rc 0) 00000100:00100000:2.0:1787075846.632534:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700772480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 275us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075846.632541:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787075846.632998:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700772480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787075846.633017:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996190038000/0x859911ad6869f574 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f57b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075846.633026:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996190038000/0x859911ad6869f574 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f57b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075846.633074:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700772608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787075846.633101:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075846.633120:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961912ccc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787075846.634927:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700772608 00000100:00100000:2.0:1787075846.634938:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700772608 00000100:00100000:2.0:1787075846.634987:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787075846.634997:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619102a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700772608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787075846.635257:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619102a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700772608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (2154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075846.635265:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787075846.635365:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700772608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787075846.635405:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700772736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787075846.635456:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075846.635490:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961912ccc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787075846.635590:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700772736 00000100:00100000:2.0:1787075846.635594:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700772736 00000100:00100000:2.0:1787075846.635615:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787075846.635621:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619102b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700772736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075846.635791:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619102b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700772736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075846.635798:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787075846.637465:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700772736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075846.637929:0:8556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f6a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8556:1873884700772864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787075846.637991:0:8556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075846.638026:0:8556:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62e180 going to sleep for 11 seconds 00000100:00100000:1.0:1787075846.638107:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700772864 00000100:00100000:1.0:1787075846.638113:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700772864 00000100:00100000:1.0:1787075846.638151:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787075846.638158:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619102bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:8556:x1873884700772864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787075846.638467:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619102bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:8556:x1873884700772864:12345-0@lo:502:llog_process_th.0 Request processed in 308us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075846.638474:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787075846.638548:0:8556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f6a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8556:1873884700772864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787075846.638572:0:8556:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787075846.638581:0:8556:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787075846.638582:0:8556:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787075846.638589:0:8556:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9961a03a5800 00000020:00000080:3.0:1787075846.638592:0:8556:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787075846.638688:0:8556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf657100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8556:1873884700772992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787075846.638719:0:8556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075846.638749:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700772992 00000100:00100000:3.0:1787075846.638752:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700772992 00000100:00100000:3.0:1787075846.638775:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787075846.638781:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619102b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:8556:x1873884700772992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787075846.640046:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619102b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:8556:x1873884700772992:12345-0@lo:502:llog_process_th.0 Request processed in 1259us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075846.640057:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787075846.640113:0:8556:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bec05480 going to sleep for 11 seconds 00000100:00100000:3.0:1787075846.640129:0:8556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf657100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:8556:1873884700772992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787075846.640154:0:8556:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787075846.640160:0:8556:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787075846.640161:0:8556:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787075846.640165:0:8556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787075846.640565:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787075846.640583:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787075846.640594:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190038000/0x859911ad6869f574 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f57b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075846.640617:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996190038000/0x859911ad6869f574 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f57b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075847.050794:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075848.073997:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075848.908790:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700773120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075848.908867:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075848.909000:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700773120 00000100:00100000:2.0:1787075848.909008:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700773120 00000100:00100000:2.0:1787075848.909068:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787075848.909078:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700773120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787075848.909112:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075848.909153:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700773120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075848.909161:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787075848.909181:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787075848.909243:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f6a680 x1873884700773120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075848.909717:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700773120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787075848.909795:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787075848.911017:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787075848.911040:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700773632:0@lo:400:kworker.0 00000100:00100000:0.0:1787075848.911092:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075848.911146:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700773376:0@lo:400:kworker.0 00000100:00100000:3.0:1787075848.913947:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700773632 00000100:00100000:3.0:1787075848.913962:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700773632 00000100:00100000:3.0:1787075848.914038:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787075848.914051:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700773632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075848.914140:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700773632:12345-0@lo:400:kworker.0 Request processed in 93us (3046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075848.914147:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787075848.914170:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787075848.914202:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b00fe300 x1873884700773632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075848.914217:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700773632:0@lo:400:kworker.0 00000100:00100000:0.0:1787075848.916491:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075848.916530:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787075848.916542:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700773504:0@lo:400:kworker.0 00000100:00100000:0.0:1787075848.916567:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075848.916602:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700773376 00000100:00100000:0.0:1787075848.916609:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700773376 00000100:00100000:0.0:1787075848.916675:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700773504 00000100:00100000:0.0:1787075848.916679:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700773504 00000100:00100000:0.0:1787075848.916713:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787075848.916722:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700773376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075848.916770:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700773376:12345-0@lo:400:kworker.0 Request processed in 49us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075848.916778:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787075848.916795:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787075848.916802:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700773504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075848.916830:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700773504:12345-0@lo:400:kworker.0 Request processed in 29us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075848.916836:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787075848.916868:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700773504:0@lo:400:kworker.0 00000100:00100000:0.0:1787075848.916879:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700773376:0@lo:400:kworker.0 00000100:00080000:3.0:1787075848.917015:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787075848.917246:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700773248:0@lo:400:kworker.0 00000100:00100000:2.0:1787075848.917291:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075848.918556:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700773248 00000100:00100000:2.0:1787075848.918564:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700773248 00000100:00100000:2.0:1787075848.918618:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787075848.918626:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3311:x1873884700773248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075848.918704:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3311:x1873884700773248:12345-0@lo:400:kworker.0 Request processed in 78us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075848.918712:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787075848.918755:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700773248:0@lo:400:kworker.0 00000100:00100000:1.0:1787075848.921183:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700773760:0@lo:400:kworker.0 00000100:00100000:1.0:1787075848.921245:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075848.921319:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700773760 00000100:00100000:1.0:1787075848.921327:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700773760 00000100:00100000:1.0:1787075848.921382:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787075848.921390:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700773760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075848.921436:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700773760:12345-0@lo:400:kworker.0 Request processed in 47us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075848.921443:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787075848.921467:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075848.921493:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700773760:0@lo:400:kworker.0 00000100:00100000:0.0:1787075849.003000:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075849.003046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075849.003071:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075849.003117:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075849.003145:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678724096 00000100:00100000:0.0:1787075849.003155:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678724096 00000100:00100000:0.0:1787075849.003208:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678724224 00000100:00100000:0.0:1787075849.003210:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678724224 00000100:00100000:0.0:1787075849.003231:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:0.0:1787075849.003240:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678724096:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075849.003331:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678724096:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 92us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075849.003339:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:0.0:1787075849.003355:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:0.0:1787075849.003361:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678724224:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075849.003384:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678724224:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 23us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075849.003390:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:0.0:1787075849.003408:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678723968 00000100:00100000:0.0:1787075849.003412:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678723968 00000100:00100000:0.0:1787075849.003439:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:0.0:1787075849.003457:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2362:x1873884678723968:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075849.003485:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2362:x1873884678723968:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 30us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075849.003491:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:1.0:1787075849.003699:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678723840 00000100:00100000:1.0:1787075849.003704:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678723840 00000100:00100000:1.0:1787075849.003733:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 190 00000100:00100000:1.0:1787075849.003741:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2362:x1873884678723840:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075849.003779:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2362:x1873884678723840:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 39us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075849.003786:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 190 00000100:00080000:1.0:1787075849.003816:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787075849.003821:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787075849.003823:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787075849.096511:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075849.929622:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700773888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787075849.929715:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075849.929846:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700773888 00000100:00100000:2.0:1787075849.929854:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700773888 00000100:00100000:2.0:1787075849.929908:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787075849.929918:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700773888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787075849.929965:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075849.930022:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700773888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075849.930029:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787075849.930227:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f68000 x1873884700773888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075849.930248:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700773888:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787075850.129254:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787075851.143899:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075852.167785:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787075852.643620:0:8819:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1787075853.191769:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075854.026018:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700774016:0@lo:400:kworker.0 00000100:00100000:3.0:1787075854.026036:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700774400:0@lo:400:kworker.0 00000100:00100000:1.0:1787075854.026059:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700774272:0@lo:400:kworker.0 00000100:00100000:2.0:1787075854.026188:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700774144:0@lo:400:kworker.0 00000100:00100000:3.0:1787075854.029607:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075854.029630:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075854.029664:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075854.029707:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787075854.029721:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700774528:0@lo:400:kworker.0 00000100:00100000:1.0:1787075854.029735:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700774784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787075854.029753:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075854.029764:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700774400 00000100:00100000:0.0:1787075854.029772:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700774400 00000100:00100000:3.0:1787075854.029787:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700774272 00000100:00100000:3.0:1787075854.029790:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700774272 00000100:00100000:1.0:1787075854.029803:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075854.029827:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700774528 00000100:00100000:3.0:1787075854.029830:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700774528 00000100:00100000:0.0:1787075854.029830:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787075854.029841:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700774400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075854.029858:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787075854.029865:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700774272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075854.029870:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787075854.029883:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700774528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075854.029889:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075854.029910:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700774272:12345-0@lo:400:kworker.0 Request processed in 44us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075854.029912:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700774400:12345-0@lo:400:kworker.0 Request processed in 75us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075854.029917:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700774656:0@lo:400:kworker.0 00000100:00100000:3.0:1787075854.029919:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787075854.029922:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787075854.029935:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700774528:12345-0@lo:400:kworker.0 Request processed in 54us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075854.029943:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787075854.029952:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700774144 00000100:00100000:3.0:1787075854.029957:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700774144 00000100:00100000:2.0:1787075854.029957:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075854.029957:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700774016 00000100:00100000:0.0:1787075854.029962:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700774016 00000100:00100000:3.0:1787075854.029993:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787075854.029993:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787075854.029995:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700774272:0@lo:400:kworker.0 00000100:00100000:3.0:1787075854.030003:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700774144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075854.030003:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700774016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075854.030014:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700774784 00000100:00100000:2.0:1787075854.030019:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700774784 00000100:00100000:3.0:1787075854.030044:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700774144:12345-0@lo:400:kworker.0 Request processed in 42us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075854.030052:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787075854.030061:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787075854.030071:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700774784:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787075854.030087:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700774528:0@lo:400:kworker.0 00010000:00080000:3.0:1787075854.030102:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b00fed80 x1873884700774400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:2.0:1787075854.030103:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787075854.030119:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700774400:0@lo:400:kworker.0 00000100:00100000:3.0:1787075854.030175:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700774656 00000100:00100000:3.0:1787075854.030178:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700774656 00000100:00100000:0.0:1787075854.030192:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700774016:12345-0@lo:400:kworker.0 Request processed in 193us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075854.030199:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787075854.030199:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787075854.030220:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1873884700774656:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787075854.030237:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787075854.030242:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787075854.030243:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787075854.030249:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1873884700774656:12345-0@lo:400:kworker.0 Request processed in 31us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075854.030255:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787075854.030273:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700774016:0@lo:400:kworker.0 00000100:00100000:3.0:1787075854.030292:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700774144:0@lo:400:kworker.0 00010000:00080000:3.0:1787075854.030301:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b00fc000 x1873884700774656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075854.030309:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700774656:0@lo:400:kworker.0 00000100:00100000:2.0:1787075854.030358:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700774784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 288us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075854.030366:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787075854.030926:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f69500 x1873884700774784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075854.030943:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700774784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787075854.115181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075854.115235:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075854.115276:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075854.115319:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075854.115726:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678724608 00000100:00100000:1.0:1787075854.115736:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678724608 00000100:00100000:1.0:1787075854.115805:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678724736 00000100:00100000:1.0:1787075854.115808:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678724736 00000100:00100000:1.0:1787075854.115832:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:1.0:1787075854.115842:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678724608:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075854.115918:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678724608:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 76us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075854.115926:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:0.0:1787075854.115940:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678724352 00000100:00100000:0.0:1787075854.115946:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678724352 00000100:00100000:1.0:1787075854.115948:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:1.0:1787075854.115959:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678724736:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075854.115985:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 192 00000100:00100000:1.0:1787075854.115991:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678724736:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 32us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075854.115999:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2362:x1873884678724352:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075854.116003:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:0.0:1787075854.116039:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2362:x1873884678724352:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 44us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075854.116060:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 192 00000100:00100000:2.0:1787075854.116506:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678724480 00000100:00100000:2.0:1787075854.116513:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678724480 00000100:00100000:2.0:1787075854.116558:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:2.0:1787075854.116566:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2362:x1873884678724480:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075854.116773:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2362:x1873884678724480:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 206us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075854.116780:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00080000:3.0:1787075854.117193:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787075854.117209:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787075854.117212:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787075854.216250:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075855.048334:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787075855.048358:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700774912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787075855.048437:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075855.048563:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700774912 00000100:00100000:1.0:1787075855.048572:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700774912 00000100:00100000:1.0:1787075855.048784:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787075855.048797:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700774912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787075855.048834:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075855.048881:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700774912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075855.053242:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787075855.053310:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961bf3a5880 x1873884700774912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075855.053334:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700774912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787075855.244353:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075856.268776:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075857.290740:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787075857.425061:0:9063:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing yml_node 00010000:00010000:0.0:1787075858.312198:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075859.144344:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700775296:0@lo:400:kworker.0 00000100:00100000:3.0:1787075859.144378:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700775424:0@lo:400:kworker.0 00000100:00100000:3.0:1787075859.144467:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075859.144565:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787075859.144573:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700775040:0@lo:400:kworker.0 00000100:00100000:3.0:1787075859.144618:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075859.144680:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700775168:0@lo:400:kworker.0 00000100:00100000:3.0:1787075859.144685:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700775552:0@lo:400:kworker.0 00000100:00100000:2.0:1787075859.144731:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075859.144768:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075859.144800:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700775680:0@lo:400:kworker.0 00000100:00100000:2.0:1787075859.144841:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075859.144902:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700775040 00000100:00100000:1.0:1787075859.144905:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075859.144912:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700775040 00000100:00100000:3.0:1787075859.144935:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700775424 00000100:00100000:3.0:1787075859.144944:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700775424 00000100:00100000:1.0:1787075859.144946:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700775808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787075859.144969:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787075859.144983:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075859.144983:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700775040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075859.145029:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700775680 00000100:00100000:3.0:1787075859.145036:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700775680 00000100:00100000:1.0:1787075859.145047:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787075859.145051:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700775040:12345-0@lo:400:kworker.0 Request processed in 74us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075859.145059:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787075859.145060:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700775424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075859.145078:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787075859.145093:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700775680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075859.145119:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700775424:12345-0@lo:400:kworker.0 Request processed in 46us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075859.145121:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700775168 00000100:00100000:0.0:1787075859.145126:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700775168 00000100:00100000:1.0:1787075859.145127:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787075859.145161:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700775552 00000100:00100000:1.0:1787075859.145162:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700775296 00000100:00100000:1.0:1787075859.145165:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700775296 00000100:00100000:0.0:1787075859.145165:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700775552 00000100:00100000:0.0:1787075859.145185:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787075859.145192:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700775168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075859.145211:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787075859.145216:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700775552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075859.145232:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700775168:12345-0@lo:400:kworker.0 Request processed in 40us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075859.145238:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787075859.145242:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700775552:12345-0@lo:400:kworker.0 Request processed in 26us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075859.145247:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787075859.145250:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787075859.145255:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700775296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075859.145265:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700775808 00000100:00100000:1.0:1787075859.145268:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700775808 00000100:00100000:0.0:1787075859.145285:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700775296:12345-0@lo:400:kworker.0 Request processed in 30us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075859.145289:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787075859.145291:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787075859.145294:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1873884700775808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787075859.145323:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787075859.145346:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700775296:0@lo:400:kworker.0 00000100:00100000:1.0:1787075859.145352:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1873884700775808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075859.145357:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787075859.145371:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f68700 x1873884700775808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075859.145386:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700775808:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787075859.145393:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787075859.145403:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787075859.145405:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787075859.145414:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700775040:0@lo:400:kworker.0 00000100:00100000:0.0:1787075859.145425:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700775552:0@lo:400:kworker.0 00010000:00080000:0.0:1787075859.145436:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f56a00 x1873884700775424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075859.145445:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700775424:0@lo:400:kworker.0 00010000:00080000:2.0:1787075859.148296:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f54700 x1873884700775680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787075859.148315:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700775680:0@lo:400:kworker.0 00000100:00100000:2.0:1787075859.148352:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700775168:0@lo:400:kworker.0 00000100:00100000:3.0:1787075859.148456:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700775680:12345-0@lo:400:kworker.0 Request processed in 3360us (3605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075859.148475:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787075859.233364:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075859.233438:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075859.234278:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678724864 00000100:00100000:2.0:1787075859.234294:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678724864 00000100:00100000:2.0:1787075859.234379:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 194 00000100:00100000:2.0:1787075859.234390:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2359:x1873884678724864:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075859.234488:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2359:x1873884678724864:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 99us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075859.234497:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 194 00000100:00100000:1.0:1787075859.236153:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678724992 00000100:00100000:1.0:1787075859.236173:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678724992 00000100:00100000:1.0:1787075859.236291:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:1.0:1787075859.236306:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678724992:12345-192.168.204.50@tcp:400:kworker.0 00000100:00080000:3.0:1787075859.236323:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075859.236426:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678724992:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 122us (3078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075859.236435:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:0.0:1787075859.239075:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075859.239198:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075859.239287:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678725120 00000100:00100000:1.0:1787075859.239299:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678725120 00000100:00100000:3.0:1787075859.239342:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678725248 00000100:00100000:3.0:1787075859.239348:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678725248 00000100:00100000:1.0:1787075859.239669:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:1.0:1787075859.239680:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2358:x1873884678725120:12345-192.168.204.50@tcp:9:kworker.0 00000020:00000080:1.0:1787075859.239730:0:6704:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f4b7 00000100:00080000:1.0:1787075859.239740:0:6704:0:(import.c:65:import_set_state_nolock()) ffff9961bfdcb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787075859.239776:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787075859.240138:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+2:2358:x1873884678725120:12345-192.168.204.50@tcp:9:kworker.0 Request processed in 458us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075859.240146:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:3.0:1787075859.240359:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:3.0:1787075859.240367:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2358:x1873884678725248:12345-192.168.204.50@tcp:9:kworker.0 00000020:00000080:3.0:1787075859.240387:0:6706:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f4be 00000100:00080000:3.0:1787075859.240393:0:6706:0:(import.c:65:import_set_state_nolock()) ffff9961bf064800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787075859.240418:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1787075859.240525:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075859.240537:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787075859.240789:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787075859.240794:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787075859.242330:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+2:2358:x1873884678725248:12345-192.168.204.50@tcp:9:kworker.0 Request processed in 1953us (3121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075859.242343:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00010000:00010000:2.0:1787075859.336168:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075860.167888:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787075860.167914:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700775936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787075860.167989:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075860.168148:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700775936 00000100:00100000:3.0:1787075860.168158:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700775936 00000100:00100000:3.0:1787075860.168210:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787075860.168219:0:6708:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787075860.168221:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700775936:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787075860.168232:0:6708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1787075860.168274:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787075860.168343:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700775936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075860.168361:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787075860.168492:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f56680 x1873884700775936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075860.168515:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700775936:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787075860.360206:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075861.396849:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787075861.709617:0:9257:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.1 00000001:00100000:0.0:1787075861.782542:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a850c61f-0242-4b36-8952-7b46dff1f2b9 00000020:00000080:0.0:1787075861.782550:0:6728:0:(genops.c:906:class_export_put()) final put ffff9961bfdc9800/a850c61f-0242-4b36-8952-7b46dff1f2b9 00000020:00000080:0.0:1787075861.782573:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9961bfdc9800/a850c61f-0242-4b36-8952-7b46dff1f2b9 for lustre-OST0000 00000020:00000080:0.0:1787075861.782617:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961bfdcb800 for lustre-OST0000 00010000:00010000:2.0:1787075862.408171:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075863.431975:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787075863.839594:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a850c61f-0242-4b36-8952-7b46dff1f2b9 00000020:00000080:1.0:1787075863.839631:0:7657:0:(genops.c:906:class_export_put()) final put ffff9961bf066000/a850c61f-0242-4b36-8952-7b46dff1f2b9 00000020:00000080:3.0:1787075863.839824:0:484:0:(genops.c:865:class_export_destroy()) destroying export ffff9961bf066000/a850c61f-0242-4b36-8952-7b46dff1f2b9 for lustre-OST0001 00000020:00000080:3.0:1787075863.839899:0:484:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961bf064800 for lustre-OST0001 00000100:00100000:1.0:1787075864.265607:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700776320:0@lo:400:kworker.0 00000100:00100000:1.0:1787075864.265725:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075864.265859:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700776448:0@lo:400:kworker.0 00000100:00100000:3.0:1787075864.265912:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075864.265970:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787075864.265977:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700776064:0@lo:400:kworker.0 00000100:00100000:3.0:1787075864.266020:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075864.266046:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700776576:0@lo:400:kworker.0 00000100:00100000:3.0:1787075864.266069:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075864.266101:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700776064 00000100:00100000:3.0:1787075864.266110:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700776064 00000100:00100000:3.0:1787075864.266175:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787075864.266186:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700776064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075864.266242:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700776064:12345-0@lo:400:kworker.0 Request processed in 58us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075864.266250:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787075864.266288:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700776320 00000100:00100000:3.0:1787075864.266291:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700776320 00000100:00100000:3.0:1787075864.266329:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700776576 00000100:00100000:3.0:1787075864.266332:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700776576 00000100:00100000:3.0:1787075864.266354:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787075864.266360:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700776320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075864.266392:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700776320:12345-0@lo:400:kworker.0 Request processed in 33us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075864.266411:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787075864.266424:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787075864.266430:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700776576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075864.266457:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700776576:12345-0@lo:400:kworker.0 Request processed in 27us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075864.266463:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1787075864.266479:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075864.266514:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700776064:0@lo:400:kworker.0 00000100:00100000:3.0:1787075864.266528:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700776576:0@lo:400:kworker.0 00000100:00100000:1.0:1787075864.266851:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700776320:0@lo:400:kworker.0 00000100:00100000:1.0:1787075864.266868:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787075864.266876:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700776192:0@lo:400:kworker.0 00000100:00100000:1.0:1787075864.266954:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075864.266980:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700776704:0@lo:400:kworker.0 00000100:00100000:1.0:1787075864.267011:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075864.267046:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700776192 00000100:00100000:1.0:1787075864.267051:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700776192 00000100:00100000:1.0:1787075864.267079:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787075864.267087:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700776192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075864.267109:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700776448 00000100:00100000:2.0:1787075864.267114:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700776448 00000100:00100000:1.0:1787075864.267123:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700776192:12345-0@lo:400:kworker.0 Request processed in 37us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075864.267130:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787075864.267148:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700776704 00000100:00100000:2.0:1787075864.267151:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700776704 00000100:00100000:2.0:1787075864.267173:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787075864.267180:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700776448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075864.267234:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700776448:12345-0@lo:400:kworker.0 Request processed in 55us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075864.267241:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787075864.267254:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787075864.267260:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700776704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075864.267264:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700776192:0@lo:400:kworker.0 00000100:00100000:2.0:1787075864.267294:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700776704:12345-0@lo:400:kworker.0 Request processed in 34us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075864.267301:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787075864.267306:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996184e04700 x1873884700776704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075864.267319:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700776704:0@lo:400:kworker.0 00000100:00080000:2.0:1787075864.267332:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787075864.267335:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787075864.267353:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f54000 x1873884700776448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787075864.267363:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700776448:0@lo:400:kworker.0 00000100:00100000:3.0:1787075864.273919:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787075864.273954:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700776832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787075864.274067:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075864.274595:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700776832 00000100:00100000:2.0:1787075864.274619:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700776832 00000100:00100000:2.0:1787075864.274698:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787075864.274710:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700776832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787075864.274774:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075864.274857:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700776832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075864.274865:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1787075864.274991:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f68e00 x1873884700776832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075864.275027:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700776832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787075864.371039:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075864.371160:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075864.371229:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678725504 00000100:00100000:1.0:1787075864.371244:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678725504 00000100:00100000:1.0:1787075864.371330:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:1.0:1787075864.371341:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2362:x1873884678725504:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075864.371435:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2362:x1873884678725504:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 95us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075864.371443:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00080000:2.0:1787075864.371972:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075864.375858:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678725376 00000100:00100000:3.0:1787075864.376010:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678725376 00000100:00100000:3.0:1787075864.376129:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 196 00000100:00100000:3.0:1787075864.376142:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2362:x1873884678725376:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075864.376250:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2362:x1873884678725376:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 112us (5226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075864.376258:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 196 00000001:02000400:0.0:1787075864.423801:0:9357:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.1 00010000:00010000:2.0:1787075864.456383:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075865.290275:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787075865.290566:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a53ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700776960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787075865.290698:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075865.291565:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700776960 00000100:00100000:2.0:1787075865.291583:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700776960 00000100:00100000:2.0:1787075865.291657:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787075865.291668:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700776960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787075865.291712:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075865.291796:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700776960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075865.291804:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787075865.292042:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961a53ddf80 x1873884700776960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075865.292065:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a53ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700776960:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787075865.483717:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075866.506252:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787075867.355424:0:9454:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.1 00010000:00010000:2.0:1787075867.539099:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075868.551843:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787075868.762209:0:9503:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Aug 18 13:57:47 EDT 2026 00000100:00100000:0.0:1787075869.388059:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700777088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787075869.388168:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075869.388364:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700777088 00000100:00100000:2.0:1787075869.388376:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700777088 00000100:00100000:2.0:1787075869.388463:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787075869.388476:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700777088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787075869.388534:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075869.388599:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700777088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075869.388607:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787075869.388977:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787075869.389022:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f69880 x1873884700777088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075869.389112:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700777088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787075869.394981:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700777344:0@lo:400:kworker.0 00000100:00100000:2.0:1787075869.395134:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700777216:0@lo:400:kworker.0 00000100:00100000:2.0:1787075869.395221:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075869.395273:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873884700777728:0@lo:400:kworker.0 00000100:00100000:2.0:1787075869.395307:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075869.395363:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700777216 00000100:00100000:2.0:1787075869.395373:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700777216 00000100:00100000:2.0:1787075869.395434:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787075869.395443:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3311:x1873884700777216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075869.395520:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3311:x1873884700777216:12345-0@lo:400:kworker.0 Request processed in 66us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075869.395528:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787075869.395597:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700777216:0@lo:400:kworker.0 00000100:00100000:2.0:1787075869.395663:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700777472:0@lo:400:kworker.0 00000100:00100000:2.0:1787075869.395820:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075869.395844:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787075869.395851:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700777600:0@lo:400:kworker.0 00000100:00100000:2.0:1787075869.395878:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075869.395917:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700777600 00000100:00100000:2.0:1787075869.395922:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700777600 00000100:00100000:2.0:1787075869.395964:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787075869.395972:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700777600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075869.396012:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700777600:12345-0@lo:400:kworker.0 Request processed in 41us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075869.396019:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787075869.396126:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f56a00 x1873884700777600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787075869.396139:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700777600:0@lo:400:kworker.0 00000100:00100000:2.0:1787075869.396172:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700777728 00000100:00100000:2.0:1787075869.396175:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700777728 00000100:00100000:2.0:1787075869.396206:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700777472 00000100:00100000:2.0:1787075869.396209:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700777472 00000100:00100000:2.0:1787075869.396228:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787075869.396234:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873884700777728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075869.396285:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873884700777728:12345-0@lo:400:kworker.0 Request processed in 51us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075869.396292:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787075869.396303:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787075869.396309:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700777472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075869.396339:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700777472:12345-0@lo:400:kworker.0 Request processed in 30us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075869.396344:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787075869.396368:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700777472:0@lo:400:kworker.0 00000100:00100000:2.0:1787075869.396391:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873884700777728:0@lo:400:kworker.0 00000100:00100000:3.0:1787075869.396635:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787075869.396806:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787075869.396812:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787075869.396909:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700777344 00000100:00100000:2.0:1787075869.396915:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700777344 00000100:00100000:2.0:1787075869.396950:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787075869.396957:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700777344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075869.396995:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700777344:12345-0@lo:400:kworker.0 Request processed in 39us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075869.397001:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787075869.397410:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700777344:0@lo:400:kworker.0 00000100:00100000:0.0:1787075869.475590:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075869.475677:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075869.475765:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678725632 00000100:00100000:1.0:1787075869.475779:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678725632 00000100:00100000:1.0:1787075869.475855:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 198 00000100:00100000:1.0:1787075869.475867:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2360:x1873884678725632:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075869.475969:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2360:x1873884678725632:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 103us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075869.475978:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 198 00000100:00100000:3.0:1787075869.476346:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678725760 00000100:00100000:3.0:1787075869.476352:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678725760 00000100:00100000:3.0:1787075869.476426:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:3.0:1787075869.476435:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2360:x1873884678725760:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075869.476481:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2360:x1873884678725760:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 48us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075869.476488:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00080000:1.0:1787075869.477896:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787075869.576741:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075870.407791:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787075870.407817:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a53df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700777856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787075870.407910:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075870.407987:0:9220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700777856 00000100:00100000:0.0:1787075870.407995:0:9220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700777856 00000100:00100000:0.0:1787075870.408060:0:9220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787075870.408071:0:9220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700777856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787075870.408107:0:9220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787075870.408167:0:9220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700777856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075870.408175:0:9220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787075870.408223:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961a53df800 x1873884700777856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075870.408247:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a53df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700777856:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787075870.605213:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075871.624308:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075872.650373:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075873.671845:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787075874.503882:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787075874.503909:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a53df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700777984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787075874.504058:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075874.505049:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a53dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700778112:0@lo:400:kworker.0 00000100:00100000:0.0:1787075874.505111:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075874.505145:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a53ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873884700778624:0@lo:400:kworker.0 00000100:00100000:0.0:1787075874.505170:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075874.505191:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787075874.505196:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a53dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700778496:0@lo:400:kworker.0 00000100:00100000:0.0:1787075874.505218:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075874.505243:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a53df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700778240:0@lo:400:kworker.0 00000100:00100000:0.0:1787075874.505262:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075874.505279:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787075874.505285:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a53ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700778368:0@lo:400:kworker.0 00000100:00100000:0.0:1787075874.505305:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075874.506880:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700777984 00000100:00100000:1.0:1787075874.506892:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700777984 00000100:00100000:1.0:1787075874.506962:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787075874.506963:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700778112 00000100:00100000:0.0:1787075874.506968:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700778112 00000100:00100000:1.0:1787075874.506973:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700777984:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787075874.506997:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787075874.507004:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700778112:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1787075874.507016:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075874.507071:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700777984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (3013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075874.507072:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700778112:12345-0@lo:400:kworker.0 Request processed in 67us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075874.507079:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787075874.507079:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787075874.507114:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700778624 00000100:00100000:0.0:1787075874.507118:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700778624 00000100:00100000:0.0:1787075874.507144:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700778240 00000100:00100000:0.0:1787075874.507147:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700778240 00000100:00100000:0.0:1787075874.507156:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700778368 00000100:00100000:0.0:1787075874.507159:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700778368 00000100:00100000:0.0:1787075874.507172:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787075874.507178:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873884700778624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075874.507220:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873884700778624:12345-0@lo:400:kworker.0 Request processed in 42us (2049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075874.507227:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787075874.507240:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787075874.507245:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700778240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075874.507276:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700778240:12345-0@lo:400:kworker.0 Request processed in 30us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075874.507281:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787075874.507292:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787075874.507298:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700778368:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787075874.507393:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787075874.507398:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787075874.507516:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700778496 00000100:00100000:1.0:1787075874.507526:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700778496 00000100:00100000:1.0:1787075874.507579:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787075874.507585:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700778496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075874.507617:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700778496:12345-0@lo:400:kworker.0 Request processed in 33us (2398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075874.507623:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787075874.507929:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961a53dce00 x1873884700778496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075874.507944:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a53dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700778496:0@lo:400:kworker.0 00000100:00100000:1.0:1787075874.508024:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a53dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700778112:0@lo:400:kworker.0 00000100:00100000:1.0:1787075874.508038:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a53ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873884700778624:0@lo:400:kworker.0 00010000:00080000:1.0:1787075874.508050:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961a53df800 x1873884700777984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075874.508063:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a53df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700777984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075874.508106:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a53df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700778240:0@lo:400:kworker.0 00000100:00100000:0.0:1787075874.508710:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700778368:12345-0@lo:400:kworker.0 Request processed in 1408us (3399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075874.508720:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1787075874.508816:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787075874.508900:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a53ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700778368:0@lo:400:kworker.0 00000100:00100000:2.0:1787075874.593111:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075874.593167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075874.593694:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678725888 00000100:00100000:3.0:1787075874.593712:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678725888 00000100:00100000:3.0:1787075874.593789:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 200 00000100:00100000:1.0:1787075874.593792:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678726016 00000100:00100000:3.0:1787075874.593815:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2360:x1873884678725888:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075874.593815:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678726016 00000100:00100000:1.0:1787075874.593893:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:1.0:1787075874.593905:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2360:x1873884678726016:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075874.594985:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2360:x1873884678725888:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 1175us (1875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075874.595000:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 200 00000100:00080000:3.0:1787075874.595235:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075874.596386:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2360:x1873884678726016:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 2470us (3205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075874.596402:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 51 00010000:00010000:0.0:1787075874.696886:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075875.527803:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787075875.527830:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a53dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700778752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787075875.527916:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075875.527994:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700778752 00000100:00100000:0.0:1787075875.528003:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700778752 00000100:00100000:0.0:1787075875.528073:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787075875.528084:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700778752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787075875.528139:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787075875.528203:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700778752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075875.528212:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787075875.528271:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961a53dc700 x1873884700778752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787075875.528304:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a53dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700778752:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787075875.724406:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075876.744030:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075877.769782:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075878.792266:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075879.624316:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787075879.624345:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700778880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075879.624429:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075879.624500:0:9220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700778880 00000100:00100000:1.0:1787075879.624510:0:9220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700778880 00000100:00100000:1.0:1787075879.624567:0:9220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787075879.624576:0:9220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700778880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787075879.624615:0:9220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075879.624694:0:9220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700778880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075879.624712:0:9220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787075879.624757:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996184e06680 x1873884700778880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075879.624778:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700778880:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787075879.625061:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787075879.626161:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700779008:0@lo:400:kworker.0 00000100:00100000:3.0:1787075879.626229:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075879.626265:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700779520:0@lo:400:kworker.0 00000100:00100000:3.0:1787075879.626331:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075879.626356:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787075879.626375:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700779136:0@lo:400:kworker.0 00000100:00100000:3.0:1787075879.626400:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075879.626431:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700779392:0@lo:400:kworker.0 00000100:00100000:3.0:1787075879.626474:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075879.626495:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787075879.626500:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700779264:0@lo:400:kworker.0 00000100:00100000:3.0:1787075879.626537:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075879.626572:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700779008 00000100:00100000:3.0:1787075879.626579:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700779008 00000100:00100000:3.0:1787075879.626624:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787075879.626632:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700779008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075879.626718:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700779008:12345-0@lo:400:kworker.0 Request processed in 86us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075879.626726:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787075879.626760:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700779520 00000100:00100000:3.0:1787075879.626763:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700779520 00000100:00100000:3.0:1787075879.626797:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700779136 00000100:00100000:3.0:1787075879.626800:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700779136 00000100:00100000:3.0:1787075879.626811:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700779264 00000100:00100000:3.0:1787075879.626813:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700779264 00000100:00100000:3.0:1787075879.626827:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787075879.626833:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700779520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075879.626879:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700779520:12345-0@lo:400:kworker.0 Request processed in 47us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075879.626886:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787075879.626899:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787075879.626904:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700779136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075879.627555:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700779136:12345-0@lo:400:kworker.0 Request processed in 648us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075879.627563:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787075879.627579:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787075879.627586:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700779264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075879.627626:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700779264:12345-0@lo:400:kworker.0 Request processed in 41us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075879.627633:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787075879.627689:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700779392 00000100:00100000:3.0:1787075879.627695:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700779392 00000100:00100000:3.0:1787075879.627741:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787075879.627748:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700779392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075879.627776:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700779392:12345-0@lo:400:kworker.0 Request processed in 30us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075879.627782:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787075879.627810:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787075879.627815:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075879.628502:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700779264:0@lo:400:kworker.0 00010000:00080000:3.0:1787075879.628527:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b00fc000 x1873884700779392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075879.628539:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700779392:0@lo:400:kworker.0 00000100:00100000:3.0:1787075879.628591:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700779136:0@lo:400:kworker.0 00000100:00100000:3.0:1787075879.628602:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700779008:0@lo:400:kworker.0 00000100:00100000:3.0:1787075879.628613:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700779520:0@lo:400:kworker.0 00000100:00100000:0.0:1787075879.716619:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075879.716717:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075879.716755:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678726272 00000100:00100000:0.0:1787075879.716765:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678726272 00000100:00100000:0.0:1787075879.716823:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:0.0:1787075879.716833:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2360:x1873884678726272:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075879.716935:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2360:x1873884678726272:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 102us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075879.716943:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00080000:0.0:1787075879.717056:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075879.717745:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678726144 00000100:00100000:3.0:1787075879.717754:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678726144 00000100:00100000:3.0:1787075879.717800:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 202 00000100:00100000:3.0:1787075879.717810:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2360:x1873884678726144:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075879.717870:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2360:x1873884678726144:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 61us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075879.717877:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 202 00010000:00010000:0.0:1787075879.816260:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075880.648242:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787075880.648268:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700779648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787075880.648348:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075880.648531:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700779648 00000100:00100000:2.0:1787075880.648540:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700779648 00000100:00100000:2.0:1787075880.649675:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787075880.649700:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700779648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787075880.649747:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075880.649819:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700779648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075880.649827:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787075880.656131:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996188f68e00 x1873884700779648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075880.656162:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700779648:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787075880.843881:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075881.864955:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075882.888539:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075883.911841:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787075884.476978:0:10133:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 13:58:03 (1787075883) === 00000100:00100000:1.0:1787075884.749630:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787075884.749667:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700779776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075884.749737:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075884.749801:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700779776 00000100:00100000:1.0:1787075884.749809:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700779776 00000100:00100000:1.0:1787075884.749876:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787075884.749885:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700779776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787075884.749920:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075884.749963:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700779776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075884.749971:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787075884.750013:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996184e05500 x1873884700779776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075884.750032:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700779776:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787075884.750156:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787075884.752519:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700779904:0@lo:400:kworker.0 00000100:00100000:2.0:1787075884.752531:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700780288:0@lo:400:kworker.0 00000100:00100000:1.0:1787075884.752596:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075884.752598:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075884.752670:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700780416:0@lo:400:kworker.0 00000100:00100000:2.0:1787075884.754448:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700780288 00000100:00100000:2.0:1787075884.754466:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700780288 00000100:00100000:1.0:1787075884.754851:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075884.754907:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700780032:0@lo:400:kworker.0 00000100:00100000:1.0:1787075884.754951:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075884.754970:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787075884.754977:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700780160:0@lo:400:kworker.0 00000100:00100000:1.0:1787075884.755001:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075884.755042:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700780416 00000100:00100000:1.0:1787075884.755046:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700780416 00000100:00100000:1.0:1787075884.755079:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700780032 00000100:00100000:1.0:1787075884.755082:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700780032 00000100:00100000:1.0:1787075884.755096:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700780160 00000100:00100000:1.0:1787075884.755098:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700780160 00000100:00100000:1.0:1787075884.755116:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787075884.755125:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700780416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075884.755194:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700780416:12345-0@lo:400:kworker.0 Request processed in 70us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075884.755201:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787075884.755220:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787075884.755226:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700780032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075884.755259:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700780032:12345-0@lo:400:kworker.0 Request processed in 33us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075884.755265:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787075884.755276:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787075884.755282:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700780160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075884.755307:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700780160:12345-0@lo:400:kworker.0 Request processed in 26us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075884.755313:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787075884.755350:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700780416:0@lo:400:kworker.0 00000100:00100000:1.0:1787075884.755378:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700780160:0@lo:400:kworker.0 00000100:00100000:1.0:1787075884.755388:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700780032:0@lo:400:kworker.0 00000100:00100000:3.0:1787075884.755710:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700779904 00000100:00100000:3.0:1787075884.755716:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700779904 00000100:00100000:3.0:1787075884.755748:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787075884.755755:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3312:x1873884700779904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075884.755809:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3312:x1873884700779904:12345-0@lo:400:kworker.0 Request processed in 54us (3216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075884.755816:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787075884.755862:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700779904:0@lo:400:kworker.0 00000100:00100000:2.0:1787075884.756006:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787075884.756017:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700780288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075884.756068:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700780288:12345-0@lo:400:kworker.0 Request processed in 54us (3474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075884.756074:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787075884.756844:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996184e07480 x1873884700780288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075884.756858:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700780288:0@lo:400:kworker.0 00000100:00080000:2.0:1787075884.756926:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787075884.756933:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787075884.830916:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075884.831015:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075884.831080:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678726400 00000100:00100000:3.0:1787075884.831097:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678726400 00000100:00100000:3.0:1787075884.831173:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 204 00000100:00100000:3.0:1787075884.831183:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2359:x1873884678726400:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075884.831291:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2359:x1873884678726400:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 109us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075884.831320:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 204 00000100:00100000:1.0:1787075884.833331:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678726528 00000100:00100000:1.0:1787075884.833349:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678726528 00000100:00100000:0.0:1787075884.835537:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:0.0:1787075884.835554:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678726528:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075884.835914:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678726528:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 353us (5009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075884.835925:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00080000:2.0:1787075884.836306:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787075884.936000:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075885.070089:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075885.070182:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678726656 00000100:00100000:3.0:1787075885.070192:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678726656 00000100:00100000:3.0:1787075885.070262:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 205 00000100:00100000:3.0:1787075885.070272:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:8124:x1873884678726656:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787075885.070291:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075885.070311:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996183be7800/0x859911ad6869f582 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623345 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075885.070344:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996183be7800/0x859911ad6869f582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623345 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075885.070357:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996183be7800/0x859911ad6869f582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623345 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075885.070366:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996183be7800, rc 0) 00000100:00100000:3.0:1787075885.070428:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+11:8124:x1873884678726656:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 157us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075885.070435:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 205 00000100:00100000:2.0:1787075885.078876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075885.079454:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678726784 00000100:00100000:0.0:1787075885.079482:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678726784 00000100:00100000:0.0:1787075885.079689:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 206 00000100:00100000:0.0:1787075885.079700:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+11:8124:x1873884678726784:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787075885.080031:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+11:8124:x1873884678726784:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 331us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075885.080039:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 206 00000100:00100000:2.0:1787075885.083672:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075885.083807:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678726912 00000100:00100000:0.0:1787075885.083818:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678726912 00000100:00100000:0.0:1787075885.083868:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 207 00000100:00100000:0.0:1787075885.083879:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+11:8124:x1873884678726912:12345-192.168.204.50@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787075885.084374:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+11:8124:x1873884678726912:12345-192.168.204.50@tcp:503:mount.lustre.0 Request processed in 495us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075885.084384:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 207 00000100:00100000:2.0:1787075885.097376:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075885.097478:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678727040 00000100:00100000:0.0:1787075885.097490:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678727040 00000100:00100000:0.0:1787075885.097559:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 208 00000100:00100000:0.0:1787075885.097570:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+11:8128:x1873884678727040:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787075885.097953:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+11:8128:x1873884678727040:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 384us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075885.097962:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 208 00000100:00100000:2.0:1787075885.110117:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075885.110279:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678727168 00000100:00100000:0.0:1787075885.110290:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678727168 00000100:00100000:0.0:1787075885.110350:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 209 00000100:00100000:0.0:1787075885.110361:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+11:8128:x1873884678727168:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787075885.110797:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+11:8128:x1873884678727168:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 436us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075885.110813:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 209 00000100:00100000:2.0:1787075885.125115:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075885.127758:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678727296 00000100:00100000:3.0:1787075885.127775:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678727296 00000100:00100000:3.0:1787075885.127922:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 210 00000100:00100000:3.0:1787075885.127934:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+11:8124:x1873884678727296:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787075885.127953:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075885.127973:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996183be7600/0x859911ad6869f589 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762336f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075885.128452:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996183be7600/0x859911ad6869f589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762336f expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075885.128465:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996183be7600/0x859911ad6869f589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762336f expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075885.128475:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996183be7600, rc 0) 00000100:00100000:3.0:1787075885.128808:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:8124:x1873884678727296:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 875us (3703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075885.128816:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 210 00000100:00100000:2.0:1787075885.132436:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075885.132534:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678727424 00000100:00100000:3.0:1787075885.132546:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678727424 00000100:00100000:3.0:1787075885.132616:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 211 00000100:00100000:3.0:1787075885.132628:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:8124:x1873884678727424:12345-192.168.204.50@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787075885.132701:0:5846:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787075885.132729:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787075885.132744:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787075885.132749:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787075885.132751:0:5846:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787075885.134942:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:8124:x1873884678727424:12345-192.168.204.50@tcp:256:mount.lustre.0 Request processed in 2306us (2506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075885.134958:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 211 00000100:00100000:2.0:1787075885.139376:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075885.139516:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678727552 00000100:00100000:3.0:1787075885.139609:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678727552 00000100:00100000:0.0:1787075885.139990:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 212 00000100:00100000:0.0:1787075885.140013:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:8124:x1873884678727552:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787075885.140032:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075885.140051:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181497c00/0x859911ad6869f590 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623376 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075885.140262:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181497c00/0x859911ad6869f590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623376 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075885.140276:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181497c00/0x859911ad6869f590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623376 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075885.140286:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181497c00, rc 0) 00000100:00100000:0.0:1787075885.140351:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:8124:x1873884678727552:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 351us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075885.140357:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 212 00000100:00100000:2.0:1787075885.143759:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075885.144080:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678727680 00000100:00100000:3.0:1787075885.144094:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678727680 00000100:00100000:3.0:1787075885.144231:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 213 00000100:00100000:3.0:1787075885.144252:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:8124:x1873884678727680:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787075885.144980:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:8124:x1873884678727680:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 726us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075885.144993:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 213 00000100:00100000:2.0:1787075885.147784:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075885.148030:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678727808 00000100:00100000:0.0:1787075885.148048:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678727808 00000100:00100000:0.0:1787075885.148132:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 214 00000100:00100000:0.0:1787075885.148146:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:8124:x1873884678727808:12345-192.168.204.50@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787075885.148498:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:8124:x1873884678727808:12345-192.168.204.50@tcp:503:mount.lustre.0 Request processed in 355us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075885.148508:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 214 00000100:00100000:2.0:1787075885.158984:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075885.159144:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678727936 00000100:00100000:3.0:1787075885.159159:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678727936 00000100:00100000:3.0:1787075885.159244:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 215 00000100:00100000:3.0:1787075885.159257:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:8132:x1873884678727936:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787075885.159602:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:8132:x1873884678727936:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 336us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075885.159611:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 215 00000100:00100000:1.0:1787075885.164229:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075885.168242:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678728064 00000100:00100000:3.0:1787075885.168260:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678728064 00000100:00100000:3.0:1787075885.168327:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 216 00000100:00100000:3.0:1787075885.168337:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:8132:x1873884678728064:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787075885.168712:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:8132:x1873884678728064:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 375us (4499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075885.168721:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 216 00000100:00100000:2.0:1787075885.186841:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075885.186884:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075885.189336:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678728320 00000100:00100000:0.0:1787075885.189484:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678728320 00000100:00100000:0.0:1787075885.189664:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678728192 00000100:00100000:0.0:1787075885.189670:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678728192 00000100:00100000:0.0:1787075885.189915:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:0.0:1787075885.189933:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2362:x1873884678728320:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075885.190039:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2362:x1873884678728320:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 114us (3210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075885.190047:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:0.0:1787075885.190068:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:0.0:1787075885.190073:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2358:x1873884678728192:12345-192.168.204.50@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787075885.190097:0:5852:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 3b46436a-eac8-40ba-903d-0628e5cbe0d3@192.168.204.50@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:0.0:1787075885.190142:0:5852:0:(genops.c:1406:class_connect()) connect: client 3b46436a-eac8-40ba-903d-0628e5cbe0d3, cookie 0x859911ad6869f597 00000004:00100000:0.0:1787075885.190191:0:5852:0:(mdt_handler.c:7347:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787075885.190507:0:5852:0:(import.c:65:import_set_state_nolock()) ffff9961b00b0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787075885.190543:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:2358:x1873884678728192:12345-192.168.204.50@tcp:38:mount.lustre.0 Request processed in 467us (3657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075885.190550:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:2.0:1787075885.199970:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075885.200572:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075885.200677:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678728448 00000100:00100000:3.0:1787075885.200688:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678728448 00000100:00100000:3.0:1787075885.200817:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678728576 00000100:00100000:3.0:1787075885.200820:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678728576 00000100:00100000:3.0:1787075885.200846:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:3.0:1787075885.200857:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+7:0:x1873884678728448:12345-192.168.204.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787075885.200907:0:5853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787075885.201013:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+7:0:x1873884678728448:12345-192.168.204.50@tcp:41:mount.lustre.0 Request processed in 157us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075885.201021:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:3.0:1787075885.201039:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:3.0:1787075885.201045:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:8124:x1873884678728576:12345-192.168.204.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787075885.201056:0:5853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787075885.201078:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:8124:x1873884678728576:12345-192.168.204.50@tcp:41:mount.lustre.0 Request processed in 34us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075885.201358:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00080000:2.0:1787075885.201836:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787075885.207222:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075885.210588:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678728704 00000100:00100000:0.0:1787075885.210616:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678728704 00000100:00100000:0.0:1787075885.210772:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:0.0:1787075885.210784:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:8124:x1873884678728704:12345-192.168.204.50@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787075885.210910:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:8124:x1873884678728704:12345-192.168.204.50@tcp:40:mount.lustre.0 Request processed in 128us (3699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075885.210918:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:3.0:1787075885.214189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075885.214893:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678729088 00000100:00100000:2.0:1787075885.214904:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678729088 00000100:00100000:2.0:1787075885.214978:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:2.0:1787075885.214990:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:8124:x1873884678729088:12345-192.168.204.50@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787075885.215320:0:5855:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787075885.215487:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:8124:x1873884678729088:12345-192.168.204.50@tcp:33:mount.lustre.0 Request processed in 498us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075885.215495:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:2.0:1787075885.217875:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075885.218008:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678728832 00000100:00100000:3.0:1787075885.218020:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678728832 00000100:00100000:3.0:1787075885.218074:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:3.0:1787075885.218095:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1873884678728832:12345-192.168.204.50@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787075885.218128:0:6705:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 3b46436a-eac8-40ba-903d-0628e5cbe0d3@192.168.204.50@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:3.0:1787075885.218161:0:6705:0:(genops.c:1406:class_connect()) connect: client 3b46436a-eac8-40ba-903d-0628e5cbe0d3, cookie 0x859911ad6869f59e 00002000:00100000:3.0:1787075885.218174:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3b46436a-eac8-40ba-903d-0628e5cbe0d3/ffff9961bf083800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787075885.218210:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1787075885.219485:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075885.219696:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678728960 00000100:00100000:3.0:1787075885.219705:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678728960 00000100:00100000:3.0:1787075885.219746:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:3.0:1787075885.219753:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1873884678728960:12345-192.168.204.50@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787075885.219782:0:6704:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 3b46436a-eac8-40ba-903d-0628e5cbe0d3@192.168.204.50@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:3.0:1787075885.219809:0:6704:0:(genops.c:1406:class_connect()) connect: client 3b46436a-eac8-40ba-903d-0628e5cbe0d3, cookie 0x859911ad6869f5a5 00002000:00100000:3.0:1787075885.219828:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3b46436a-eac8-40ba-903d-0628e5cbe0d3/ffff9961bf084800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787075885.219838:0:6704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787075885.220365:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787075885.220395:0:6704:0:(import.c:65:import_set_state_nolock()) ffff9961bf080000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787075885.220465:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:2358:x1873884678728960:12345-192.168.204.50@tcp:8:mount.lustre.0 Request processed in 710us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075885.220473:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00002000:00080000:1.0:1787075885.225342:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787075885.225389:0:6705:0:(import.c:65:import_set_state_nolock()) ffff996182cce800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787075885.225482:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:2358:x1873884678728832:12345-192.168.204.50@tcp:8:mount.lustre.0 Request processed in 7398us (7615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075885.225494:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:1.0:1787075885.769224:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700780544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787075885.769354:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075885.769672:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700780544 00000100:00100000:2.0:1787075885.769682:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700780544 00000100:00100000:2.0:1787075885.769754:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787075885.769765:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700780544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787075885.769788:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075885.769848:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700780544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075885.769855:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787075885.769895:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b516f800 x1873884700780544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075885.769932:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700780544:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787075885.960215:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787075886.984504:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787075887.346910:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3b46436a-eac8-40ba-903d-0628e5cbe0d3 00010000:00010000:3.0:1787075888.011294:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787075888.880480:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3b46436a-eac8-40ba-903d-0628e5cbe0d3 00010000:00010000:3.0:1787075889.031811:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787075889.420863:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3b46436a-eac8-40ba-903d-0628e5cbe0d3 00000100:00100000:2.0:1787075889.865152:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787075889.865189:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700780672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787075889.865260:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075889.865465:0:9220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700780672 00000100:00100000:1.0:1787075889.865473:0:9220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700780672 00000100:00100000:1.0:1787075889.865546:0:9220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787075889.865555:0:9220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700780672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787075889.865590:0:9220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075889.865666:0:9220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700780672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075889.865675:0:9220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1787075889.865776:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787075889.865810:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996184e05880 x1873884700780672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787075889.865830:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700780672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787075889.868669:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a53ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700781184:0@lo:400:kworker.0 00000100:00100000:0.0:1787075889.868749:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075889.868797:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787075889.868803:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a53df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873884700781056:0@lo:400:kworker.0 00000100:00100000:0.0:1787075889.868853:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075889.868891:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700781184 00000100:00100000:0.0:1787075889.868899:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700781184 00000100:00100000:0.0:1787075889.868958:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787075889.868968:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700781184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075889.869017:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700781184:12345-0@lo:400:kworker.0 Request processed in 51us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075889.869025:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787075889.869046:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700781056 00000100:00100000:0.0:1787075889.869049:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700781056 00000100:00100000:0.0:1787075889.869078:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787075889.869084:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873884700781056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075889.869114:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873884700781056:12345-0@lo:400:kworker.0 Request processed in 31us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075889.869121:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1787075889.869144:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787075889.869149:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787075889.869178:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a53df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873884700781056:0@lo:400:kworker.0 00010000:00080000:0.0:1787075889.869192:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961a53ded80 x1873884700781184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075889.869218:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a53ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700781184:0@lo:400:kworker.0 00000100:00100000:3.0:1787075889.869357:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a53ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700780800:0@lo:400:kworker.0 00000100:00100000:3.0:1787075889.869420:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075889.869452:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a53dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873884700781312:0@lo:400:kworker.0 00000100:00100000:3.0:1787075889.869473:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075889.869492:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787075889.869512:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a53df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700780928:0@lo:400:kworker.0 00000100:00100000:3.0:1787075889.869536:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075889.869562:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700781312 00000100:00100000:3.0:1787075889.869566:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700781312 00000100:00100000:3.0:1787075889.869596:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700780928 00000100:00100000:3.0:1787075889.869599:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700780928 00000100:00100000:3.0:1787075889.869619:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787075889.869627:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873884700781312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075889.869697:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873884700781312:12345-0@lo:400:kworker.0 Request processed in 70us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075889.869713:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787075889.869730:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787075889.869736:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700780928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075889.869765:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700780928:12345-0@lo:400:kworker.0 Request processed in 29us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075889.869771:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1787075889.869788:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075889.869806:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a53df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700780928:0@lo:400:kworker.0 00000100:00100000:3.0:1787075889.869815:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a53dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873884700781312:0@lo:400:kworker.0 00000100:00100000:0.0:1787075889.870578:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700780800 00000100:00100000:0.0:1787075889.870588:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700780800 00000100:00100000:0.0:1787075889.870637:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787075889.870849:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3311:x1873884700780800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075889.870925:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3311:x1873884700780800:12345-0@lo:400:kworker.0 Request processed in 80us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075889.871017:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a53ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700780800:0@lo:400:kworker.0 00000100:00100000:0.0:1787075889.871246:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00010000:00010000:3.0:1787075890.059549:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075890.476780:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075890.476844:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075890.476888:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075890.476910:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075890.476937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075890.476984:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678729472 00000100:00100000:2.0:1787075890.476998:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678729472 00000100:00100000:2.0:1787075890.477085:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678729344 00000100:00100000:2.0:1787075890.477092:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678729344 00000100:00100000:2.0:1787075890.477134:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:2.0:1787075890.477153:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2362:x1873884678729472:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075890.477259:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2362:x1873884678729472:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 114us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075890.477268:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:2.0:1787075890.477285:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:2.0:1787075890.477292:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2362:x1873884678729344:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075890.477318:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2362:x1873884678729344:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 26us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075890.477325:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:2.0:1787075890.477343:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678729728 00000100:00100000:2.0:1787075890.477352:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678729728 00000100:00100000:2.0:1787075890.477379:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678729600 00000100:00100000:2.0:1787075890.477382:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678729600 00000100:00100000:2.0:1787075890.477401:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:2.0:1787075890.477407:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2362:x1873884678729728:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075890.477434:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2362:x1873884678729728:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 26us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075890.477440:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:2.0:1787075890.477452:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:2.0:1787075890.477466:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2362:x1873884678729600:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075890.477509:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2362:x1873884678729600:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 44us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075890.477515:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00080000:2.0:1787075890.477536:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787075890.477540:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787075890.477542:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787075890.477740:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678729216 00000100:00100000:0.0:1787075890.477747:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678729216 00000100:00100000:0.0:1787075890.477801:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 218 00000100:00100000:0.0:1787075890.477812:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2362:x1873884678729216:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075890.477856:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2362:x1873884678729216:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 46us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075890.477865:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 218 00000001:02000400:1.0:1787075890.644307:0:10330:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1787075890.891233:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700781440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787075890.891311:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075890.892943:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700781440 00000100:00100000:2.0:1787075890.892958:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700781440 00000100:00100000:2.0:1787075890.894090:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787075890.894124:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700781440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787075890.894167:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075890.894272:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700781440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (2960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075890.894279:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787075890.894437:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b516ed80 x1873884700781440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075890.894460:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700781440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787075891.079918:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075892.108724:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787075893.128153:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075894.151875:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075894.984477:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787075894.984511:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961becb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700781568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787075894.984633:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075894.984866:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700781568 00000100:00100000:3.0:1787075894.984878:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700781568 00000100:00100000:3.0:1787075894.984972:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787075894.984984:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700781568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787075894.985032:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787075894.985094:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700781568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075894.985102:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1787075894.985485:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787075894.985528:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961becb1f80 x1873884700781568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075894.985565:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961becb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700781568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075894.985871:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700781952:0@lo:400:kworker.0 00000100:00100000:1.0:1787075894.985933:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075894.985965:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787075894.985971:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700781824:0@lo:400:kworker.0 00000100:00100000:1.0:1787075894.986025:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075894.986063:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700781952 00000100:00100000:1.0:1787075894.986069:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700781952 00000100:00100000:1.0:1787075894.986117:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700781824 00000100:00100000:1.0:1787075894.986121:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700781824 00000100:00100000:1.0:1787075894.986150:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787075894.986158:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700781952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075894.986205:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700781952:12345-0@lo:400:kworker.0 Request processed in 47us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075894.986212:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787075894.986227:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787075894.986232:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700781824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075894.986261:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700781824:12345-0@lo:400:kworker.0 Request processed in 29us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075894.986268:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1787075894.986296:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075894.986316:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700781824:0@lo:400:kworker.0 00000100:00100000:1.0:1787075894.986327:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700781952:0@lo:400:kworker.0 00000100:00100000:0.0:1787075894.986533:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700781696:0@lo:400:kworker.0 00000100:00100000:0.0:1787075894.986593:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075894.986663:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873884700782208:0@lo:400:kworker.0 00000100:00100000:0.0:1787075894.986690:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075894.986717:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787075894.986723:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700782080:0@lo:400:kworker.0 00000100:00100000:0.0:1787075894.986748:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075894.986778:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700782080 00000100:00100000:0.0:1787075894.986783:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700782080 00000100:00100000:0.0:1787075894.986824:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787075894.986832:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700782080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075894.986871:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700782080:12345-0@lo:400:kworker.0 Request processed in 40us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075894.986879:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1787075894.986899:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787075894.987047:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700782208 00000100:00100000:3.0:1787075894.987052:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700782208 00000100:00100000:3.0:1787075894.987093:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787075894.987104:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873884700782208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075894.987144:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873884700782208:12345-0@lo:400:kworker.0 Request processed in 45us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075894.987150:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1787075894.987230:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996184e07480 x1873884700782080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075894.987242:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700782080:0@lo:400:kworker.0 00000100:00100000:0.0:1787075894.987254:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873884700782208:0@lo:400:kworker.0 00000100:00080000:0.0:1787075894.987283:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075894.988318:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700781696 00000100:00100000:1.0:1787075894.988331:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700781696 00000100:00100000:1.0:1787075894.988388:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787075894.988398:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700781696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075894.988497:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700781696:12345-0@lo:400:kworker.0 Request processed in 101us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075894.988504:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787075894.988782:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700781696:0@lo:400:kworker.0 00010000:00010000:3.0:1787075895.177674:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075895.586313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075895.586552:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075895.586603:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678729984 00000100:00100000:2.0:1787075895.586616:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678729984 00000100:00100000:3.0:1787075895.586851:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678729856 00000100:00100000:3.0:1787075895.586857:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678729856 00000100:00100000:3.0:1787075895.586928:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 220 00000100:00100000:3.0:1787075895.586940:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2360:x1873884678729856:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075895.587039:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2360:x1873884678729856:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 101us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075895.587048:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 220 00000100:00100000:2.0:1787075895.587844:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:2.0:1787075895.587859:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2360:x1873884678729984:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075895.587923:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2360:x1873884678729984:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 68us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075895.587931:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00080000:2.0:1787075895.595339:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075895.596270:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075895.596317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075895.596352:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075895.596353:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678730112 00000100:00100000:3.0:1787075895.596369:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678730112 00000100:00100000:3.0:1787075895.596473:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:3.0:1787075895.596487:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2360:x1873884678730112:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075895.596603:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2360:x1873884678730112:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 119us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075895.596612:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:2.0:1787075895.596766:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678730240 00000100:00100000:2.0:1787075895.596771:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678730240 00000100:00100000:2.0:1787075895.596809:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678730368 00000100:00100000:2.0:1787075895.596813:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678730368 00000100:00100000:2.0:1787075895.596858:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:2.0:1787075895.596866:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2359:x1873884678730240:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075895.596900:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2359:x1873884678730240:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 36us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075895.596907:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:2.0:1787075895.596921:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:2.0:1787075895.596927:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2360:x1873884678730368:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075895.596952:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2360:x1873884678730368:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 25us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075895.596958:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00080000:1.0:1787075895.597541:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787075895.597547:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787075895.597550:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075896.007824:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787075896.007857:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700782336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787075896.007957:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075896.008047:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700782336 00000100:00100000:1.0:1787075896.008056:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700782336 00000100:00100000:1.0:1787075896.008133:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787075896.008145:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700782336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787075896.008195:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075896.008270:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700782336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075896.008278:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1787075896.008308:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787075896.010601:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961bf756a00 x1873884700782336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075896.010666:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700782336:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787075896.199812:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787075897.223745:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075898.249944:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787075899.274815:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075900.104813:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700782592:0@lo:400:kworker.0 00000100:00100000:0.0:1787075900.105230:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075900.105312:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700783104:0@lo:400:kworker.0 00000100:00100000:0.0:1787075900.105347:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075900.105388:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787075900.105411:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700782720:0@lo:400:kworker.0 00000100:00100000:0.0:1787075900.105436:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075900.105490:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700783104 00000100:00100000:0.0:1787075900.105499:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700783104 00000100:00100000:0.0:1787075900.105577:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787075900.105589:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700783104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075900.105678:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700783104:12345-0@lo:400:kworker.0 Request processed in 91us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075900.105687:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787075900.105714:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700782592 00000100:00100000:0.0:1787075900.105718:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700782592 00000100:00100000:0.0:1787075900.105744:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700782720 00000100:00100000:0.0:1787075900.105747:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700782720 00000100:00100000:0.0:1787075900.105773:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787075900.105780:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700782592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075900.105812:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700782592:12345-0@lo:400:kworker.0 Request processed in 34us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075900.105819:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787075900.105831:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787075900.105837:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700782720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075900.105864:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700782720:12345-0@lo:400:kworker.0 Request processed in 27us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075900.105884:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787075900.105902:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787075900.105909:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787075900.105953:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700782720:0@lo:400:kworker.0 00000100:00100000:0.0:1787075900.105964:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700782592:0@lo:400:kworker.0 00010000:00080000:0.0:1787075900.105990:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961a6e45f80 x1873884700783104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075900.106001:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700783104:0@lo:400:kworker.0 00000100:00100000:1.0:1787075900.106190:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700782464:0@lo:400:kworker.0 00000100:00100000:1.0:1787075900.106234:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075900.106263:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700782976:0@lo:400:kworker.0 00000100:00100000:1.0:1787075900.106287:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075900.106331:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700782848:0@lo:400:kworker.0 00000100:00100000:3.0:1787075900.106376:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075900.106482:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700782464 00000100:00100000:0.0:1787075900.106489:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700782464 00000100:00100000:0.0:1787075900.106563:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787075900.106572:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3312:x1873884700782464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075900.106618:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3312:x1873884700782464:12345-0@lo:400:kworker.0 Request processed in 47us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075900.106625:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787075900.106733:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700782976 00000100:00100000:3.0:1787075900.106738:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700782976 00000100:00100000:3.0:1787075900.106849:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787075900.106855:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700782976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075900.107009:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700782976:12345-0@lo:400:kworker.0 Request processed in 37us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075900.107018:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787075900.107047:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700782848 00000100:00100000:3.0:1787075900.107051:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700782848 00000100:00100000:3.0:1787075900.107076:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787075900.107082:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700782848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075900.107119:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700782848:12345-0@lo:400:kworker.0 Request processed in 38us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075900.107126:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787075900.107158:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961a6e44000 x1873884700782848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075900.107170:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700782848:0@lo:400:kworker.0 00000100:00100000:3.0:1787075900.107436:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961becb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700783232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787075900.107901:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700782464:0@lo:400:kworker.0 00000100:00100000:0.0:1787075900.107920:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700782976:0@lo:400:kworker.0 00000100:00100000:3.0:1787075900.114312:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787075900.114442:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787075900.114452:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075900.114718:0:9220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700783232 00000100:00100000:1.0:1787075900.114732:0:9220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700783232 00000100:00100000:1.0:1787075900.114828:0:9220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787075900.114841:0:9220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700783232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787075900.114901:0:9220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075900.115032:0:9220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700783232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 194us (3975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075900.115041:0:9220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787075900.115314:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961becb1500 x1873884700783232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075900.115341:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961becb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700783232:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787075900.296860:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075900.709509:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075900.709552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075900.709583:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075900.709617:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075900.709684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075900.709717:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678731008 00000100:00100000:0.0:1787075900.709729:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678731008 00000100:00100000:0.0:1787075900.709799:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678730880 00000100:00100000:0.0:1787075900.709802:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678730880 00000100:00100000:0.0:1787075900.709827:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:0.0:1787075900.709836:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2359:x1873884678731008:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075900.709907:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2359:x1873884678731008:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 72us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075900.709926:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:0.0:1787075900.709944:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:0.0:1787075900.709952:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2359:x1873884678730880:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075900.709979:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2359:x1873884678730880:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 28us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075900.709985:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:0.0:1787075900.710004:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678730752 00000100:00100000:0.0:1787075900.710008:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678730752 00000100:00100000:0.0:1787075900.710036:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678730624 00000100:00100000:0.0:1787075900.710039:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678730624 00000100:00100000:0.0:1787075900.710057:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00100000:0.0:1787075900.710063:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2359:x1873884678730752:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075900.710091:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2359:x1873884678730752:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 28us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075900.710098:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00100000:0.0:1787075900.710113:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:0.0:1787075900.710119:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678730624:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075900.710140:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678730624:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 22us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075900.710146:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00080000:0.0:1787075900.710165:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787075900.710169:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787075900.710171:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787075900.710594:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678730496 00000100:00100000:1.0:1787075900.710623:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678730496 00000100:00100000:1.0:1787075900.710681:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 222 00000100:00100000:1.0:1787075900.710689:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2359:x1873884678730496:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075900.710732:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2359:x1873884678730496:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 44us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075900.710739:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 222 00000100:00100000:3.0:1787075901.129758:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700783360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787075901.129836:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075901.130324:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700783360 00000100:00100000:1.0:1787075901.130332:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700783360 00000100:00100000:1.0:1787075901.130489:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787075901.130500:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700783360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787075901.130535:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075901.130798:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700783360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 300us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075901.130805:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787075901.130997:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961b516e300 x1873884700783360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787075901.131016:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700783360:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787075901.319817:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075902.343848:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787075903.368483:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075904.394730:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075905.223910:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787075905.223935:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961becb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700783488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787075905.224016:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075905.224080:0:9220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700783488 00000100:00100000:0.0:1787075905.224087:0:9220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700783488 00000100:00100000:0.0:1787075905.224140:0:9220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787075905.224151:0:9220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700783488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787075905.224185:0:9220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787075905.224239:0:9220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700783488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075905.224246:0:9220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787075905.224266:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787075905.224299:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961becb1880 x1873884700783488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075905.224319:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961becb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700783488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787075905.224459:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961becb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873884700783744:0@lo:400:kworker.0 00000100:00100000:3.0:1787075905.224493:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075905.224513:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787075905.224520:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961becb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700783616:0@lo:400:kworker.0 00000100:00100000:3.0:1787075905.224546:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075905.224565:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961becb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873884700784128:0@lo:400:kworker.0 00000100:00100000:3.0:1787075905.224583:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075905.224740:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700783744 00000100:00100000:0.0:1787075905.224745:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700783744 00000100:00100000:2.0:1787075905.224831:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961becb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700784000:0@lo:400:kworker.0 00000100:00100000:2.0:1787075905.224861:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075905.224882:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787075905.224887:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961becb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700783872:0@lo:400:kworker.0 00000100:00100000:2.0:1787075905.224908:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075905.227459:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700784128 00000100:00100000:0.0:1787075905.227473:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700784128 00000100:00100000:0.0:1787075905.227519:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700783872 00000100:00100000:0.0:1787075905.227522:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700783872 00000100:00100000:0.0:1787075905.227543:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787075905.227553:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873884700783744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075905.227627:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873884700783744:12345-0@lo:400:kworker.0 Request processed in 76us (3132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075905.227634:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787075905.227750:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787075905.227757:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873884700784128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075905.227785:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873884700784128:12345-0@lo:400:kworker.0 Request processed in 29us (3201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075905.227799:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787075905.227811:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787075905.227818:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700783872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075905.227852:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700783872:12345-0@lo:400:kworker.0 Request processed in 35us (2943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075905.227858:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787075905.227876:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700784000 00000100:00100000:0.0:1787075905.227880:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700784000 00000100:00100000:0.0:1787075905.227907:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787075905.227914:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700784000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075905.227942:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700784000:12345-0@lo:400:kworker.0 Request processed in 29us (3081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075905.227947:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1787075905.227961:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787075905.227966:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075905.229289:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961becb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873884700784128:0@lo:400:kworker.0 00000100:00100000:3.0:1787075905.229306:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961becb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873884700783744:0@lo:400:kworker.0 00000100:00100000:2.0:1787075905.237695:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700783616 00000100:00100000:2.0:1787075905.237710:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700783616 00000100:00100000:2.0:1787075905.237769:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787075905.237779:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700783616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075905.237868:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700783616:12345-0@lo:400:kworker.0 Request processed in 91us (13321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075905.237876:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787075905.238111:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961becb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700783872:0@lo:400:kworker.0 00010000:00080000:2.0:1787075905.238134:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961becb2d80 x1873884700784000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787075905.238145:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961becb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700784000:0@lo:400:kworker.0 00000100:00100000:3.0:1787075905.238600:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961becb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700783616:0@lo:400:kworker.0 00010000:00010000:3.0:1787075905.415870:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075905.822418:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075905.822475:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075905.822561:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678731520 00000100:00100000:3.0:1787075905.822573:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678731520 00000100:00100000:3.0:1787075905.822671:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678731648 00000100:00100000:3.0:1787075905.822675:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678731648 00000100:00100000:3.0:1787075905.822702:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:3.0:1787075905.822713:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2358:x1873884678731520:12345-192.168.204.50@tcp:9:kworker.0 00000020:00000080:3.0:1787075905.822746:0:6706:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f59e 00000100:00080000:3.0:1787075905.822754:0:6706:0:(import.c:65:import_set_state_nolock()) ffff996182cce800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787075905.822795:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787075905.823239:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+2:2358:x1873884678731520:12345-192.168.204.50@tcp:9:kworker.0 Request processed in 526us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075905.823258:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:3.0:1787075905.823277:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:3.0:1787075905.823285:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b53cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2358:x1873884678731648:12345-192.168.204.50@tcp:9:kworker.0 00000020:00000080:3.0:1787075905.823299:0:6706:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f5a5 00000100:00080000:3.0:1787075905.823304:0:6706:0:(import.c:65:import_set_state_nolock()) ffff9961bf080000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787075905.823330:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787075905.823528:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b53cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+2:2358:x1873884678731648:12345-192.168.204.50@tcp:9:kworker.0 Request processed in 242us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075905.823535:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00010000:00010000:3.0:1787075905.823738:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787075905.823878:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787075905.823882:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787075905.824746:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075905.825764:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075905.825858:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075905.825889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075905.825947:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678731136 00000100:00100000:3.0:1787075905.825957:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678731136 00000100:00100000:3.0:1787075905.826012:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 224 00000100:00100000:3.0:1787075905.826022:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2359:x1873884678731136:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075905.826104:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2359:x1873884678731136:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 83us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075905.826112:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 224 00000100:00100000:2.0:1787075905.833429:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678731264 00000100:00100000:2.0:1787075905.833447:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678731264 00000100:00100000:2.0:1787075905.833528:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678731392 00000100:00100000:2.0:1787075905.833531:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678731392 00000100:00100000:2.0:1787075905.833565:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:2.0:1787075905.833576:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678731264:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075905.833681:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678731264:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 106us (7922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075905.833689:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:2.0:1787075905.833722:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 80 00000100:00100000:2.0:1787075905.833729:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2359:x1873884678731392:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075905.833755:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2359:x1873884678731392:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 27us (7865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075905.833762:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 80 00000100:00080000:0.0:1787075905.834040:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787075906.252169:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787075906.255878:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700784256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787075906.255992:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075906.266115:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700784256 00000100:00100000:1.0:1787075906.266133:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700784256 00000100:00100000:1.0:1787075906.266219:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787075906.266231:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700784256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787075906.266276:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075906.266390:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700784256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (10406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075906.266398:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787075906.267615:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961bf756680 x1873884700784256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075906.267687:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700784256:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787075906.439835:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787075906.611124:0:11030:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787075907.467955:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787075907.894589:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3b46436a-eac8-40ba-903d-0628e5cbe0d3 00000020:00000080:0.0:1787075907.894601:0:6728:0:(genops.c:906:class_export_put()) final put ffff9961bf083800/3b46436a-eac8-40ba-903d-0628e5cbe0d3 00000020:00000080:2.0:1787075907.895941:0:484:0:(genops.c:865:class_export_destroy()) destroying export ffff9961bf083800/3b46436a-eac8-40ba-903d-0628e5cbe0d3 for lustre-OST0000 00000020:00000080:2.0:1787075907.896176:0:484:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996182cce800 for lustre-OST0000 00010000:00010000:3.0:1787075908.487998:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075909.517481:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787075909.952328:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3b46436a-eac8-40ba-903d-0628e5cbe0d3 00000020:00000080:2.0:1787075909.952340:0:7657:0:(genops.c:906:class_export_put()) final put ffff9961bf084800/3b46436a-eac8-40ba-903d-0628e5cbe0d3 00000020:00000080:2.0:1787075909.952382:0:484:0:(genops.c:865:class_export_destroy()) destroying export ffff9961bf084800/3b46436a-eac8-40ba-903d-0628e5cbe0d3 for lustre-OST0001 00000020:00000080:2.0:1787075909.952472:0:484:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961bf080000 for lustre-OST0001 00000100:00100000:0.0:1787075910.347373:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700784384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787075910.347476:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075910.347596:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700784384 00000100:00100000:0.0:1787075910.347608:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700784384 00000100:00100000:0.0:1787075910.347729:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787075910.347741:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700784384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787075910.347789:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787075910.347843:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700784384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075910.347850:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1787075910.347876:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787075910.347914:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961a6e44e00 x1873884700784384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075910.347936:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700784384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075910.349908:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787075910.349936:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700784512:0@lo:400:kworker.0 00000100:00100000:1.0:1787075910.350027:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075910.350096:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700784512 00000100:00100000:1.0:1787075910.350115:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700784512 00000100:00100000:1.0:1787075910.350177:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787075910.350188:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3311:x1873884700784512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075910.350245:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3311:x1873884700784512:12345-0@lo:400:kworker.0 Request processed in 58us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075910.350253:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787075910.350313:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700784512:0@lo:400:kworker.0 00000100:00100000:1.0:1787075910.350361:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787075910.350371:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873884700784640:0@lo:400:kworker.0 00000100:00100000:1.0:1787075910.350401:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075910.350432:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700784640 00000100:00100000:1.0:1787075910.350436:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700784640 00000100:00100000:1.0:1787075910.350468:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787075910.350475:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873884700784640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075910.350513:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873884700784640:12345-0@lo:400:kworker.0 Request processed in 39us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075910.350521:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787075910.354067:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873884700784640:0@lo:400:kworker.0 00000100:00100000:1.0:1787075910.354207:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873884700784768:0@lo:400:kworker.0 00000100:00100000:1.0:1787075910.354317:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075910.354393:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700784768 00000100:00100000:1.0:1787075910.354417:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700784768 00000100:00100000:1.0:1787075910.354488:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787075910.354500:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873884700784768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075910.355203:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873884700784768:12345-0@lo:400:kworker.0 Request processed in 702us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075910.355215:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1787075910.355254:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075910.355293:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873884700784768:0@lo:400:kworker.0 00000100:00100000:1.0:1787075910.355352:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700784896:0@lo:400:kworker.0 00000100:00100000:1.0:1787075910.355390:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075910.355449:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700784896 00000100:00100000:1.0:1787075910.355455:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700784896 00000100:00100000:1.0:1787075910.355497:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787075910.355507:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700784896:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787075910.355739:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787075910.356383:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700784896:12345-0@lo:400:kworker.0 Request processed in 874us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075910.356394:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787075910.356439:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961bf755f80 x1873884700784896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075910.356452:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700784896:0@lo:400:kworker.0 00000100:00100000:1.0:1787075910.356467:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787075910.356475:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873884700785024:0@lo:400:kworker.0 00000100:00100000:1.0:1787075910.356510:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075910.363130:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700785024 00000100:00100000:0.0:1787075910.363159:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700785024 00000100:00100000:1.0:1787075910.363342:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787075910.363356:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873884700785024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075910.363509:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873884700785024:12345-0@lo:400:kworker.0 Request processed in 156us (6997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075910.363519:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1787075910.363719:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075910.367171:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873884700785024:0@lo:400:kworker.0 00000020:00000080:1.0:1787075910.385217:0:11181:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb3f51cd0 20000000:00000080:1.0:1787075910.385243:0:11181:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff996184e9dc00 uarg=0000000000000000 20000000:01000000:1.0:1787075910.385291:0:11181:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787075910.385299:0:11181:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787075910.385305:0:11181:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787075910.386443:0:11182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787075910.386596:0:11181:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787075910.397039:0:11181:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787075910.397107:0:11181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff996190038a00/0x859911ad6869f5ac lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075910.397141:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996190038e00/0x859911ad6869f551 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762333e expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075910.397153:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181496200/0x859911ad6869f55f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f558 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075910.397161:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181497400/0x859911ad6869f56d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f566 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075910.397170:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9961b9033400/0x859911ad6869f57b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f574 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075910.397178:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181497c00/0x859911ad6869f590 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623376 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075910.397214:0:11181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff996190038a00/0x859911ad6869f5ac lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075910.397296:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181497c00/0x859911ad6869f590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623376 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075910.397318:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996181497c00/0x859911ad6869f590 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623376 expref: 12 pid: 5847 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075910.398478:0:11181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf755880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873884700785152:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787075910.399452:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9961b9033400/0x859911ad6869f57b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f574 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075910.399470:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9961b9033400/0x859911ad6869f57b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f574 expref: 18 pid: 5847 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075910.399485:0:11181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf757480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873884700785280:0@lo:104: 00000100:00100000:1.0:1787075910.399546:0:11181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787075910.399607:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181497400/0x859911ad6869f56d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f566 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075910.399617:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996181497400/0x859911ad6869f56d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f566 expref: 18 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075910.399625:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700785280 00000100:00100000:1.0:1787075910.399626:0:11181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf754e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873884700785408:0@lo:104: 00000100:00100000:0.0:1787075910.399657:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700785280 00000100:00100000:1.0:1787075910.399669:0:11181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787075910.399714:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181496200/0x859911ad6869f55f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f558 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075910.399739:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996181496200/0x859911ad6869f55f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f558 expref: 18 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075910.399748:0:11181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf755180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873884700785536:0@lo:104: 00000100:00100000:1.0:1787075910.399770:0:11181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787075910.399789:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996190038e00/0x859911ad6869f551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762333e expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075910.399798:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996190038e00/0x859911ad6869f551 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762333e expref: 12 pid: 5844 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075910.399808:0:11181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf757100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873884700785664:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787075910.399832:0:11181:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618773db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787075910.399855:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700785408 00000100:00100000:0.0:1787075910.399860:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700785408 00000100:00100000:0.0:1787075910.399875:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700785536 00000100:00100000:0.0:1787075910.399877:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700785536 00000100:00100000:0.0:1787075910.399892:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787075910.399903:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf755c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+5:11181:x1873884700785280:12345-0@lo:104: 00010000:00010000:0.0:1787075910.399929:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996190038000/0x859911ad6869f574 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f57b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.400007:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787075910.400015:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf755c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+5:11181:x1873884700785280:12345-0@lo:104: Request processed in 114us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075910.400024:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787075910.400045:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787075910.400052:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf756d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+4:11181:x1873884700785408:12345-0@lo:104: 00010000:00010000:0.0:1787075910.400060:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f56d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.400111:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787075910.400116:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf756d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+4:11181:x1873884700785408:12345-0@lo:104: Request processed in 65us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075910.400122:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787075910.400138:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787075910.400145:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf756680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:11181:x1873884700785536:12345-0@lo:104: 00010000:00010000:0.0:1787075910.400153:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996190038c00/0x859911ad6869f558 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f55f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.400179:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787075910.400184:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf756680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:11181:x1873884700785536:12345-0@lo:104: Request processed in 40us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075910.400190:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787075910.400214:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787075910.400222:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996190038000/0x859911ad6869f574 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f57b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075910.400231:0:11181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf757480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873884700785280:0@lo:104: 00010000:00010000:0.0:1787075910.400243:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038000 already unused, calling callback (ffffffffc1bacc20) 00000100:00100000:1.0:1787075910.400248:0:11181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf754e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873884700785408:0@lo:104: 10000000:00010000:0.0:1787075910.400250:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996190038000/0x859911ad6869f574 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f57b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075910.400256:0:11181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf755180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873884700785536:0@lo:104: 00010000:00010000:0.0:1787075910.400267:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996190038000/0x859911ad6869f574 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f57b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787075910.400276:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996190038000/0x859911ad6869f574 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f57b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787075910.400283:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787075910.400322:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996190038000/0x859911ad6869f574 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f57b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.400329:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787075910.400353:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996190038000/0x859911ad6869f574 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f57b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.400360:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996190038000/0x859911ad6869f574 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f57b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.400376:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787075910.400379:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f56d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.400385:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181497600 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:0.0:1787075910.400388:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f56d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.400405:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f566 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f56d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787075910.400412:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f566 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f56d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787075910.400418:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787075910.400430:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f566 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f56d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.400435:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787075910.400440:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f566 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f56d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.400447:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181497600/0x859911ad6869f566 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f56d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.400457:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787075910.400460:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996190038c00/0x859911ad6869f558 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f55f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.400465:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038c00 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:0.0:1787075910.400468:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996190038c00/0x859911ad6869f558 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f55f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.400476:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996190038c00/0x859911ad6869f558 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f55f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787075910.400482:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996190038c00/0x859911ad6869f558 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f55f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787075910.400492:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787075910.400520:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996190038c00/0x859911ad6869f558 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f55f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.400527:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787075910.400543:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996190038c00/0x859911ad6869f558 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f55f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.400550:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996190038c00/0x859911ad6869f558 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f55f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.400564:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075910.400566:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075910.400567:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075910.400574:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075910.400587:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700785792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787075910.400621:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075910.400665:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787075910.400672:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700785920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787075910.400694:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075910.406725:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700786048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787075910.431153:0:11181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf755880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873884700785152:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787075910.431177:0:11181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf757100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1873884700785664:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787075910.431220:0:11181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff996190038a00/0x859911ad6869f5ac lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075910.431331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075910.431414:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700785792 00000100:00100000:3.0:1787075910.431425:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700785792 00010000:00010000:3.0:1787075910.431488:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9961b9033400/0x859911ad6869f57b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f574 expref: 19 pid: 5847 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075910.431560:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700785920 00000100:00100000:3.0:1787075910.431564:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700785920 00010000:00010000:3.0:1787075910.431580:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181497400/0x859911ad6869f56d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f566 expref: 20 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075910.431605:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787075910.431616:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a03ca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+20:3313:x1873884700785792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787075910.431652:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075910.431661:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9961b9033400/0x859911ad6869f57b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f574 expref: 20 pid: 5847 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075910.431671:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9961b9033400/0x859911ad6869f57b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f574 expref: 20 pid: 5847 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075910.431703:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961b9033400/0x859911ad6869f57b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f574 expref: 20 pid: 5847 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075910.431731:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075910.431813:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a03ca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700785792:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (31189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075910.431822:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787075910.431894:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787075910.431900:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:3313:x1873884700785920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787075910.431907:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075910.431911:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181497400/0x859911ad6869f56d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f566 expref: 18 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075910.431921:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181497400/0x859911ad6869f56d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f566 expref: 18 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075910.431938:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181497400/0x859911ad6869f56d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f566 expref: 18 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075910.431948:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075910.431974:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:3313:x1873884700785920:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (31278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075910.431980:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787075910.432020:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700785920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787075910.432030:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700785792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787075910.433242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075910.433544:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075910.433571:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678731776 00000100:00100000:3.0:1787075910.433583:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678731776 00010000:00010000:2.0:1787075910.433885:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181497c00/0x859911ad6869f590 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623376 expref: 13 pid: 5847 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075910.433928:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678731904 00000100:00100000:0.0:1787075910.433932:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678731904 00000100:00100000:0.0:1787075910.434092:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700786048 00000100:00100000:0.0:1787075910.434106:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700786048 00010000:00010000:0.0:1787075910.434129:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181496200/0x859911ad6869f55f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f558 expref: 17 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075910.434160:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:0.0:1787075910.434170:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fbce478-41bc-496b-b8c6-033a0ad89c67+14:2361:x1873884678731776:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075910.434186:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075910.434193:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181497c00/0x859911ad6869f590 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623376 expref: 14 pid: 5847 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.434208:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181497c00/0x859911ad6869f590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623376 expref: 14 pid: 5847 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.434228:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181497c00/0x859911ad6869f590 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623376 expref: 14 pid: 5847 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.434246:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075910.434324:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2361:x1873884678731776:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 154us (2994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075910.434333:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:0.0:1787075910.434354:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787075910.434362:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf754700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:3311:x1873884700786048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787075910.434372:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075910.434376:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181496200/0x859911ad6869f55f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f558 expref: 17 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.434386:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181496200/0x859911ad6869f55f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f558 expref: 17 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.434407:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181496200/0x859911ad6869f55f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f558 expref: 17 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.434418:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075910.435023:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf754700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:3311:x1873884700786048:12345-0@lo:103:ldlm_bl.0 Request processed in 660us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075910.435033:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787075910.437736:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700786048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787075910.437931:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996190038e00/0x859911ad6869f551 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762333e expref: 12 pid: 5844 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075910.437993:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:3.0:1787075910.438005:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:2361:x1873884678731904:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787075910.438024:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075910.438030:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996190038e00/0x859911ad6869f551 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762333e expref: 12 pid: 5844 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075910.438043:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996190038e00/0x859911ad6869f551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762333e expref: 12 pid: 5844 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075910.438134:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996190038e00/0x859911ad6869f551 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762333e expref: 12 pid: 5844 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075910.438157:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff996190038a00/0x859911ad6869f5ac lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075910.438187:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996190038a00/0x859911ad6869f5ac lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075910.438211:0:8465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996190038a00/0x859911ad6869f5ac lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075910.438221:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff996190038a00/0x859911ad6869f5ac lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075910.438228:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff996190038a00/0x859911ad6869f5ac lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075910.438236:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff996190038a00/0x859911ad6869f5ac lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075910.438244:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038a00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787075910.438249:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff996190038a00/0x859911ad6869f5ac lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075910.438259:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff996190038a00/0x859911ad6869f5ac lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075910.438287:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff996190038a00/0x859911ad6869f5ac lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075910.438301:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075910.438381:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fbce478-41bc-496b-b8c6-033a0ad89c67+11:2361:x1873884678731904:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 375us (5144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075910.438391:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 29 00010000:00010000:1.0:1787075910.439584:0:11181:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff996190038a00/0x859911ad6869f5ac lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075910.439604:0:11181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff996190038a00/0x859911ad6869f5ac lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075910.439611:0:11181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996190038a00/0x859911ad6869f5ac lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075910.541046:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787075910.941299:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075910.941381:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075910.941734:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678732160 00000100:00100000:0.0:1787075910.941749:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678732160 00000100:00100000:0.0:1787075910.941851:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678732032 00000100:00100000:0.0:1787075910.941855:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678732032 00000100:00080000:3.0:1787075910.941914:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075910.941961:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:3.0:1787075910.941986:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2362:x1873884678732160:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075910.942104:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:3.0:1787075910.942105:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2362:x1873884678732160:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 121us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075910.942117:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2362:x1873884678732032:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075910.942119:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:0.0:1787075910.942163:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2362:x1873884678732032:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 49us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075910.942170:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:1.0:1787075911.368351:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700786176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787075911.368455:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075911.368595:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700786176 00000100:00100000:0.0:1787075911.368607:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700786176 00000100:00100000:0.0:1787075911.368693:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787075911.368821:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700786176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787075911.368869:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787075911.368926:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700786176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 222us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075911.368933:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787075911.369022:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961bf756a00 x1873884700786176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075911.369046:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700786176:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787075911.559957:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787075911.644403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075911.644561:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678732288 00000100:00100000:0.0:1787075911.644614:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678732288 00000100:00100000:0.0:1787075911.644755:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 226 00000100:00100000:0.0:1787075911.644769:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+11:5602:x1873884678732288:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787075911.644796:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075911.644828:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181497600/0x859911ad6869f5b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76233a0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075911.644870:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181497600/0x859911ad6869f5b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233a0 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075911.644885:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181497600/0x859911ad6869f5b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233a0 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075911.644897:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181497600, rc 0) 00000100:00100000:0.0:1787075911.644968:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:5602:x1873884678732288:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 201us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075911.644977:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 226 00000100:00100000:0.0:1787075911.652053:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075911.652341:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678732416 00000100:00100000:3.0:1787075911.652358:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678732416 00000100:00100000:3.0:1787075911.652441:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 227 00000100:00100000:3.0:1787075911.652454:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:5602:x1873884678732416:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787075911.652949:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:5602:x1873884678732416:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 495us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075911.652959:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 227 00000100:00100000:3.0:1787075911.655036:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075911.655282:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678732544 00000100:00100000:1.0:1787075911.655294:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678732544 00000100:00100000:1.0:1787075911.655359:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 228 00000100:00100000:1.0:1787075911.655371:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:5602:x1873884678732544:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787075911.655700:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:5602:x1873884678732544:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 330us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075911.655914:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 228 00000100:00100000:3.0:1787075911.662196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075911.662384:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678732672 00000100:00100000:0.0:1787075911.662398:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678732672 00000100:00100000:0.0:1787075911.662470:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 229 00000100:00100000:0.0:1787075911.662482:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:5602:x1873884678732672:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787075911.662508:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075911.662535:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181497c00/0x859911ad6869f5ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76233a7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075911.662572:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181497c00/0x859911ad6869f5ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233a7 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075911.662608:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181497c00/0x859911ad6869f5ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233a7 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075911.662620:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181497c00, rc 0) 00000100:00100000:0.0:1787075911.662759:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:5602:x1873884678732672:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 278us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075911.662766:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 229 00000100:00100000:1.0:1787075911.665483:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075911.677277:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678732800 00000100:00100000:3.0:1787075911.677298:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678732800 00000100:00100000:3.0:1787075911.677412:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 230 00000100:00100000:3.0:1787075911.677426:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:5602:x1873884678732800:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787075911.677905:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:5602:x1873884678732800:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 480us (12433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075911.677915:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 230 00000100:00100000:0.0:1787075911.681952:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075911.683113:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678732928 00000100:00100000:2.0:1787075911.683129:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678732928 00000100:00100000:2.0:1787075911.683206:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 231 00000100:00100000:2.0:1787075911.683218:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:5602:x1873884678732928:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075911.683542:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:5602:x1873884678732928:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 326us (1606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075911.683561:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 231 10000000:01000000:3.0:1787075911.947846:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787075911.947877:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9961bf681000 from 7 10000000:01000000:3.0:1787075911.947883:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787075911.947962:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be6c00/0x859911ad6869f5c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075911.947977:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996183be6c00/0x859911ad6869f5c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075911.947991:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996183be6c00/0x859911ad6869f5c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075911.948027:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961becb1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700786304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787075911.948148:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075911.948226:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996185caa000 going to sleep for 11 seconds 00000100:00100000:0.0:1787075911.948477:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700786304 00000100:00100000:0.0:1787075911.948490:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700786304 00000100:00100000:0.0:1787075911.948571:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787075911.948584:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:5849:x1873884700786304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787075911.948605:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075911.948625:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181496200/0x859911ad6869f5c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f5c1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075911.948697:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181496200/0x859911ad6869f5c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f5c1 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075911.948710:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181496200/0x859911ad6869f5c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f5c1 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075911.948722:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181496200, rc 0) 00000100:00100000:0.0:1787075911.948777:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700786304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075911.948786:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787075911.949943:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961becb1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700786304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787075911.949985:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996183be6c00/0x859911ad6869f5c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f5c8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075911.949999:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996183be6c00/0x859911ad6869f5c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f5c8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075911.950279:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961becb1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700786432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787075911.950338:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075911.950430:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996185caa000 going to sleep for 11 seconds 00000100:00100000:2.0:1787075911.960153:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700786432 00000100:00100000:2.0:1787075911.960188:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700786432 00000100:00100000:2.0:1787075911.960299:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787075911.960312:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191063850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700786432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787075911.960772:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191063850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700786432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 461us (10431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075911.960782:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787075911.960863:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961becb1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700786432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787075911.960941:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700786560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075911.961019:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075911.961063:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bec05e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787075911.961091:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700786560 00000100:00100000:2.0:1787075911.961096:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700786560 00000100:00100000:2.0:1787075911.961122:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787075911.961130:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700786560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075911.961332:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700786560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075911.961340:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787075911.961382:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700786560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787075911.965017:0:11206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787075911.970910:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787075911.971010:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787075911.971029:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be6c00/0x859911ad6869f5c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f5c8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075911.971046:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996183be6c00/0x859911ad6869f5c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f5c8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787075911.971080:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787075911.971084:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9961c14da000 from 7 10000000:01000000:0.0:1787075911.971087:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787075911.971151:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181497400/0x859911ad6869f5cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075911.971161:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996181497400/0x859911ad6869f5cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075911.971185:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181497400/0x859911ad6869f5cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075911.971220:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700786688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787075911.971320:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075911.971387:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9c8c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787075911.971770:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700786688 00000100:00100000:2.0:1787075911.971781:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700786688 00000100:00100000:2.0:1787075911.971844:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787075911.971855:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700786688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787075911.971887:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075911.971907:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961b9032000/0x859911ad6869f5d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f5cf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075911.971941:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961b9032000/0x859911ad6869f5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f5cf expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075911.971953:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961b9032000/0x859911ad6869f5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f5cf expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075911.971963:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032000, rc 0) 00000100:00100000:2.0:1787075911.972021:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700786688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075911.972029:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787075911.972112:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700786688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787075911.972130:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181497400/0x859911ad6869f5cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f5d6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075911.972139:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181497400/0x859911ad6869f5cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f5d6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075911.972434:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700786816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787075911.972474:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075911.972502:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bec050c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787075911.972517:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700786816 00000100:00100000:2.0:1787075911.972521:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700786816 00000100:00100000:2.0:1787075911.972547:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787075911.972554:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700786816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787075911.976289:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700786816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3717us (3797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075911.976311:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787075911.976441:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700786816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787075911.976519:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700786944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075911.976589:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075911.976634:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bec050c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787075911.976673:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700786944 00000100:00100000:2.0:1787075911.976682:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700786944 00000100:00100000:2.0:1787075911.976729:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787075911.976741:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191062450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700786944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075911.976946:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191062450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700786944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075911.976953:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787075911.976996:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700786944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787075911.990853:0:11207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787075911.991259:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787075911.991284:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787075911.991299:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181497400/0x859911ad6869f5cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f5d6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075911.991314:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181497400/0x859911ad6869f5cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f5d6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787075911.991327:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787075911.991330:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9961a03a5800 from 7 10000000:01000000:2.0:1787075911.991333:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787075911.991408:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033c00/0x859911ad6869f5dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075911.991417:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9961b9033c00/0x859911ad6869f5dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075911.991431:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9961b9033c00/0x859911ad6869f5dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075911.991465:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700787072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787075911.991588:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075911.991661:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bec050c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787075911.991686:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700787072 00000100:00100000:2.0:1787075911.991695:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700787072 00000100:00100000:2.0:1787075911.991759:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787075911.991770:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700787072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787075911.991789:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075911.991805:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961b9033600/0x859911ad6869f5e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f5dd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075911.991841:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961b9033600/0x859911ad6869f5e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f5dd expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075911.991854:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961b9033600/0x859911ad6869f5e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f5dd expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075911.991865:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9033600, rc 0) 00000100:00100000:2.0:1787075911.991909:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191062c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700787072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075911.991917:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787075911.991983:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700787072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787075911.992000:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9961b9033c00/0x859911ad6869f5dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f5e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075911.992011:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9961b9033c00/0x859911ad6869f5dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f5e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075911.992080:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700787200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787075911.992107:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075911.992134:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bec050c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787075911.998404:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700787200 00000100:00100000:3.0:1787075911.998428:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700787200 00000100:00100000:3.0:1787075911.998508:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787075911.998522:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700787200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787075912.004175:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700787200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787075912.004289:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700787328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075912.004375:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075912.004433:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bec050c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787075912.005847:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700787328 00000100:00100000:1.0:1787075912.005866:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700787328 00000100:00100000:1.0:1787075912.005940:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787075912.005951:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191060850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+20:5849:x1873884700787328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787075912.006295:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191060850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+20:5849:x1873884700787328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 345us (1919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075912.006304:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787075912.006384:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700787328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787075912.010301:0:11208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787075912.010452:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787075912.010480:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787075912.010495:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033c00/0x859911ad6869f5dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f5e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075912.010510:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961b9033c00/0x859911ad6869f5dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f5e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075912.014696:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191060c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700787200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5146us (11555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075912.014745:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00010000:00010000:0.0:1787075912.586352:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075913.608286:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075914.632072:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787075915.187274:0:11379:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787075915.464295:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700787712:0@lo:400:kworker.0 00000100:00100000:0.0:1787075915.464731:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075915.464787:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787075915.464795:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700787840:0@lo:400:kworker.0 00000100:00100000:0.0:1787075915.464821:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075915.465996:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787075915.466021:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700788224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075915.466066:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075915.466111:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700787840 00000100:00100000:1.0:1787075915.466119:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700787840 00000100:00100000:1.0:1787075915.466200:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787075915.466210:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700787840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075915.466262:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700787840:12345-0@lo:400:kworker.0 Request processed in 53us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075915.466270:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787075915.466477:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961a6e47800 x1873884700787840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075915.466493:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700787840:0@lo:400:kworker.0 00000100:00100000:1.0:1787075915.466520:0:9220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700788224 00000100:00100000:1.0:1787075915.466523:0:9220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700788224 00000100:00100000:1.0:1787075915.466550:0:9220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787075915.466556:0:9220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700788224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787075915.466587:0:9220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075915.466623:0:9220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700788224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075915.466656:0:9220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787075915.466686:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961bf756a00 x1873884700788224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075915.466700:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700788224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787075915.467676:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873884700787584:0@lo:400:kworker.0 00000100:00100000:2.0:1787075915.467731:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075915.467762:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700788096:0@lo:400:kworker.0 00000100:00100000:2.0:1787075915.467786:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075915.467821:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787075915.467828:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700787456:0@lo:400:kworker.0 00000100:00100000:2.0:1787075915.468287:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075915.468318:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873884700787968:0@lo:400:kworker.0 00000100:00100000:2.0:1787075915.468442:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075915.468490:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700788096 00000100:00100000:2.0:1787075915.468497:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700788096 00000100:00100000:2.0:1787075915.468538:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787075915.468547:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700788096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075915.468599:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700788096:12345-0@lo:400:kworker.0 Request processed in 53us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075915.468606:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787075915.468630:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700787456 00000100:00100000:2.0:1787075915.468633:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700787456 00000100:00100000:2.0:1787075915.468678:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787075915.468685:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700787456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075915.468715:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700787456:12345-0@lo:400:kworker.0 Request processed in 31us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075915.468723:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787075915.468749:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700787712 00000100:00100000:2.0:1787075915.468753:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700787712 00000100:00100000:2.0:1787075915.468780:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700787584 00000100:00100000:2.0:1787075915.468783:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700787584 00000100:00100000:2.0:1787075915.468795:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700787968 00000100:00100000:2.0:1787075915.468797:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700787968 00000100:00100000:2.0:1787075915.468811:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787075915.468817:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700787712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075915.470510:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700787712:12345-0@lo:400:kworker.0 Request processed in 1501us (5587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075915.470528:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787075915.470561:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787075915.470574:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873884700787584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075915.470739:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700787712:0@lo:400:kworker.0 00000100:00100000:1.0:1787075915.470803:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700787456:0@lo:400:kworker.0 00000100:00100000:1.0:1787075915.470818:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873884700787584:0@lo:400:kworker.0 00010000:00080000:1.0:1787075915.470832:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961a6e47100 x1873884700788096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075915.470853:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700788096:0@lo:400:kworker.0 00000100:00100000:2.0:1787075915.471291:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873884700787584:12345-0@lo:400:kworker.0 Request processed in 70us (2907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075915.471311:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787075915.472417:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787075915.472434:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873884700787968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075915.472521:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873884700787968:12345-0@lo:400:kworker.0 Request processed in 92us (4078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075915.472527:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1787075915.472581:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787075915.472589:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787075915.472592:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787075915.474361:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873884700787968:0@lo:400:kworker.0 00010000:00010000:2.0:1787075915.656355:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787075916.063702:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075916.063797:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075916.063825:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075916.064856:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678733312 00000100:00100000:1.0:1787075916.064868:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678733312 00000100:00100000:1.0:1787075916.064946:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678733184 00000100:00100000:1.0:1787075916.064950:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678733184 00000100:00100000:1.0:1787075916.064974:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:1.0:1787075916.065112:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2359:x1873884678733312:12345-192.168.204.50@tcp:400:kworker.0 00000100:00080000:3.0:1787075916.065264:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075916.065444:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2359:x1873884678733312:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 459us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075916.065454:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:1.0:1787075916.065473:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 90 00000100:00100000:1.0:1787075916.065481:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678733184:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075916.065525:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678733184:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 46us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075916.065532:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 90 00000100:00100000:0.0:1787075916.068355:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678733056 00000100:00100000:0.0:1787075916.068390:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678733056 00000100:00100000:0.0:1787075916.068539:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 242 00000100:00100000:0.0:1787075916.068551:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2359:x1873884678733056:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075916.068659:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191062850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2359:x1873884678733056:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 93us (4951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075916.068667:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 242 00000100:00100000:2.0:1787075916.489044:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700788352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787075916.489149:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075916.489356:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700788352 00000100:00100000:1.0:1787075916.489365:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700788352 00000100:00100000:1.0:1787075916.489417:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787075916.489428:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700788352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787075916.489468:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075916.490406:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700788352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 975us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075916.490418:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787075916.490572:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961bf756a00 x1873884700788352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787075916.490598:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700788352:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787075916.680584:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075917.707801:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787075918.725921:0:11479:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 13:58:37 (1787075917) === 00010000:00010000:1.0:1787075918.738004:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075918.991680:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075918.991719:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075918.991833:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678733440 00000100:00100000:3.0:1787075918.991843:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678733440 00000100:00100000:3.0:1787075918.991917:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:3.0:1787075918.991927:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2361:x1873884678733440:12345-192.168.204.50@tcp:41:mkdir.0 00000004:00000024:3.0:1787075918.991978:0:7654:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787075918.992057:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2361:x1873884678733440:12345-192.168.204.50@tcp:41:mkdir.0 Request processed in 131us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075918.992064:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:0.0:1787075918.992328:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678733568 00000100:00100000:0.0:1787075918.992333:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678733568 00000100:00100000:0.0:1787075918.992372:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:0.0:1787075918.992380:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:9677:x1873884678733568:12345-192.168.204.50@tcp:700:mkdir.0 00000100:00100000:0.0:1787075918.992416:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:9677:x1873884678733568:12345-192.168.204.50@tcp:700:mkdir.0 Request processed in 38us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075918.992423:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00080000:2.0:1787075918.992965:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075919.001255:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075919.002427:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678733824 00000100:00100000:3.0:1787075919.002443:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678733824 00000100:00100000:3.0:1787075919.002533:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:3.0:1787075919.002542:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:9677:x1873884678733824:12345-192.168.204.50@tcp:36:mkdir.0 00010000:00010000:3.0:1787075919.002615:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075919.002693:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190039a00/0x859911ad6869f4cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623329 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.002718:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996187c34500) 00010000:00010000:3.0:1787075919.002730:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787075919.003069:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6400/0x859911ad6869f5eb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.003095:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6400/0x859911ad6869f5eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.003106:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6400/0x859911ad6869f5eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.003118:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f5f2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.003125:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f5f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.003130:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f5f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075919.004297:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787075919.004309:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6400/0x859911ad6869f5eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.004318:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6400/0x859911ad6869f5eb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.004326:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6400/0x859911ad6869f5eb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.004331:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996183be6400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075919.004336:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6400/0x859911ad6869f5eb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.004343:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6400/0x859911ad6869f5eb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.004364:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996194304400) 00010000:00010000:3.0:1787075919.004367:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075919.004371:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6400/0x859911ad6869f5eb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.004377:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6400/0x859911ad6869f5eb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787075919.004405:0:5854:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000596aa3cc reply state 00000000f962b70b transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f5f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075919.004413:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787075919.004522:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:9677:x1873884678733824:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 1978us (3274us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787075919.004533:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00010000:00010000:1.0:1787075919.007959:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f5f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.007978:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f5f2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.007986:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f5f2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.007993:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996183be7400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075919.007998:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f5f2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.008006:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f5f2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.008040:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff996194304f00) 00010000:00010000:1.0:1787075919.008043:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075919.008048:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f5f2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.008056:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f5f2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075919.030043:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075919.030114:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678733952 00000100:00100000:1.0:1787075919.030124:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678733952 00000100:00100000:1.0:1787075919.030173:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:1.0:1787075919.030182:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:9678:x1873884678733952:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:1.0:1787075919.030203:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075919.030227:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190039a00/0x859911ad6869f5f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76233ae expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.030290:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039600/0x859911ad6869f600 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.030303:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190039600/0x859911ad6869f600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.030314:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190039600/0x859911ad6869f600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075919.030371:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787075919.030375:0:7654:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787075919.030711:0:7654:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996190039600/0x859911ad6869f600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.030820:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190039a00/0x859911ad6869f5f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233ae expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.030840:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039600/0x859911ad6869f600 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233ae expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.031281:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996187c34100) 00010000:00010000:1.0:1787075919.031285:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787075919.031289:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190039600, rc 0) 00000100:00100000:1.0:1787075919.031407:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:9678:x1873884678733952:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 1225us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075919.031416:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:3.0:1787075919.035324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075919.038175:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678734208 00000100:00100000:2.0:1787075919.038191:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678734208 00000100:00100000:2.0:1787075919.038269:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:2.0:1787075919.038278:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:9678:x1873884678734208:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:2.0:1787075919.038336:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075919.038383:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190039600/0x859911ad6869f600 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233ae expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.038423:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996187c34100) 00010000:00010000:2.0:1787075919.038433:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787075919.038461:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f607 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.038481:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f607 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.038491:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f607 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787075919.039054:0:5854:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000e09e38b7 reply state 00000000dcfeb3f5 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f607 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075919.039067:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787075919.039333:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787075919.039518:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:9678:x1873884678734208:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 1238us (4204us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787075919.039527:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00010000:00010000:3.0:1787075919.049609:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f607 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.049635:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f607 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.049673:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f607 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.049680:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9033400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075919.049685:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f607 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.049694:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f607 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.049724:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b79c00) 00010000:00010000:3.0:1787075919.049727:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787075919.049732:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f607 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.049738:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f607 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075919.097732:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075919.098179:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678734336 00000100:00100000:2.0:1787075919.098190:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678734336 00000100:00100000:2.0:1787075919.098260:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:2.0:1787075919.098271:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:9679:x1873884678734336:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:2.0:1787075919.098301:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075919.098325:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f60e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76233b5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.098395:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f615 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.098436:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f615 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.098449:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f615 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075919.098509:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787075919.098514:0:5853:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787075919.098555:0:5853:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f615 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.098581:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f60e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233b5 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.098601:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f615 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233b5 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.098610:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b79e00) 00010000:00010000:2.0:1787075919.098613:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787075919.098616:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032400, rc 0) 00000100:00100000:2.0:1787075919.098963:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:9679:x1873884678734336:12345-192.168.204.50@tcp:101:chown.0 Request processed in 692us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075919.098971:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:2.0:1787075919.102755:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075919.102849:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678734464 00000100:00100000:1.0:1787075919.102860:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678734464 00000100:00100000:1.0:1787075919.102943:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:1.0:1787075919.102955:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:9679:x1873884678734464:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:1.0:1787075919.102980:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075919.103002:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190039a00/0x859911ad6869f61c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76233bc expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103085:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f623 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103099:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f623 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103109:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f623 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103140:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad6869f62a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103148:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad6869f62a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103154:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad6869f62a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103255:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038e00/0x859911ad6869f631 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103262:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038e00/0x859911ad6869f631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103268:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038e00/0x859911ad6869f631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075919.103307:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787075919.103311:0:5852:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787075919.103337:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996190038e00/0x859911ad6869f631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103348:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f623 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103355:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f623 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103361:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f623 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103376:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075919.103381:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f623 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103389:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f623 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103402:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b79e00) 00010000:00010000:1.0:1787075919.103405:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075919.103409:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f623 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103415:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f623 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103428:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad6869f62a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103433:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad6869f62a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103438:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad6869f62a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103443:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075919.103445:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad6869f62a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103451:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad6869f62a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103470:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff996187c34d00) 00010000:00010000:1.0:1787075919.103473:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075919.103476:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad6869f62a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103482:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad6869f62a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103510:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190039a00/0x859911ad6869f61c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233bc expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103525:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038e00/0x859911ad6869f631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233bc expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.103532:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996187c34400) 00010000:00010000:1.0:1787075919.103534:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787075919.103536:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190038e00, rc 0) 00000100:00100000:1.0:1787075919.103602:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:9679:x1873884678734464:12345-192.168.204.50@tcp:101:chown.0 Request processed in 649us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075919.103609:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:3.0:1787075919.107323:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075919.112290:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678734720 00000100:00100000:2.0:1787075919.112306:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678734720 00000100:00100000:2.0:1787075919.112383:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:2.0:1787075919.112395:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:9679:x1873884678734720:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:2.0:1787075919.112483:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075919.112510:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038e00/0x859911ad6869f631 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233bc expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.112543:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996187c34400) 00010000:00010000:2.0:1787075919.112555:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787075919.112582:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f638 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.112595:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.112605:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787075919.221476:0:5853:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000eb60077d reply state 000000001d8c8976 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075919.221496:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787075919.221845:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00200000:2.0:1787075919.222214:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787075919.222338:0:5853:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787075919.222354:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:9679:x1873884678734720:12345-192.168.204.50@tcp:36:chown.0 Request processed in 109958us (115038us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787075919.222363:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00010000:00010000:1.0:1787075919.222695:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.222706:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f638 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.222713:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f638 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.222732:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075919.222738:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f638 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.222746:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f638 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.222761:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996191b79f00) 00010000:00010000:1.0:1787075919.222764:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787075919.222769:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f638 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.222775:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f638 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075919.253351:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075919.258603:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678734848 00000100:00100000:1.0:1787075919.258621:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678734848 00000100:00100000:1.0:1787075919.258725:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:1.0:1787075919.258736:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:9680:x1873884678734848:12345-192.168.204.50@tcp:101:touch.500 00010000:00010000:1.0:1787075919.258763:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075919.258783:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad6869f63f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76233c3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787075919.261556:0:5852:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2722us 00010000:00010000:1.0:1787075919.291703:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f646 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.291727:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f646 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.291739:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f646 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.291766:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad6869f64d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.291774:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad6869f64d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.291780:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad6869f64d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292317:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad6869f654 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292328:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad6869f654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292334:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad6869f654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075919.292416:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787075919.292421:0:5852:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787075919.292520:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad6869f654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292534:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f646 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292540:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f646 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292547:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f646 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292563:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075919.292568:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f646 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292575:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f646 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292587:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b79e00) 00010000:00010000:1.0:1787075919.292590:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075919.292595:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f646 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292600:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad6869f646 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292612:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad6869f64d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292618:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad6869f64d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292624:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad6869f64d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292630:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075919.292632:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad6869f64d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292672:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad6869f64d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292692:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff996187c34d00) 00010000:00010000:1.0:1787075919.292694:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075919.292697:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad6869f64d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292703:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad6869f64d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292748:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad6869f63f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233c3 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292765:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad6869f654 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233c3 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.292771:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996187c34000) 00010000:00010000:1.0:1787075919.292773:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787075919.292775:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190038000, rc 0) 00000100:00100000:1.0:1787075919.292872:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:9680:x1873884678734848:12345-192.168.204.50@tcp:101:touch.500 Request processed in 34137us (40248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075919.292882:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:1.0:1787075919.304397:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075919.304436:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678735104 00000100:00100000:1.0:1787075919.304446:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678735104 00000100:00100000:1.0:1787075919.304504:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:1.0:1787075919.304516:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:9680:x1873884678735104:12345-192.168.204.50@tcp:101:touch.500 00010000:00010000:1.0:1787075919.304541:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075919.304565:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190039a00/0x859911ad6869f65b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76233ca expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.305031:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038e00/0x859911ad6869f662 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.305047:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038e00/0x859911ad6869f662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.305059:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038e00/0x859911ad6869f662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.305075:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039600/0x859911ad6869f669 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.305082:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190039600/0x859911ad6869f669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.305088:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190039600/0x859911ad6869f669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787075919.306037:0:7654:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787075919.306342:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869f670 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.306354:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869f670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.306363:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869f670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.306397:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038e00/0x859911ad6869f662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.306412:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038e00/0x859911ad6869f662 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.306418:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190038e00/0x859911ad6869f662 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.306423:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038e00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075919.306427:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038e00/0x859911ad6869f662 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.306435:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038e00/0x859911ad6869f662 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.306449:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996187c34000) 00010000:00010000:1.0:1787075919.306452:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075919.306457:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190038e00/0x859911ad6869f662 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.306462:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038e00/0x859911ad6869f662 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787075919.306476:0:7654:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000827678c5 reply state 00000000419ffb88 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff996190039600/0x859911ad6869f669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075919.306484:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787075919.306520:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190039a00/0x859911ad6869f65b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233ca expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.306538:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869f670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233ca expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.306556:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff996187c34b00) 00010000:00010000:1.0:1787075919.306559:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787075919.306561:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632800, rc 0) 00000100:00100000:1.0:1787075919.306671:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+10:9680:x1873884678735104:12345-192.168.204.50@tcp:101:touch.500 Request processed in 2157us (2284us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787075919.306680:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:2.0:1787075919.316691:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075919.316725:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678735360 00000100:00100000:2.0:1787075919.316735:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678735360 00000100:00100000:2.0:1787075919.316788:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:2.0:1787075919.316798:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+10:9680:x1873884678735360:12345-192.168.204.50@tcp:36:touch.500 00010000:00010000:2.0:1787075919.316877:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075919.316907:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869f670 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233ca expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.316936:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff996187c34b00) 00010000:00010000:2.0:1787075919.316949:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787075919.317016:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f67e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.317031:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f67e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.317040:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f67e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787075919.317206:0:5854:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 000000000b78ba77 reply state 0000000067470bea transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f67e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075919.317218:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787075919.317345:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+11:9680:x1873884678735360:12345-192.168.204.50@tcp:36:touch.500 Request processed in 547us (667us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787075919.317352:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 23 00010000:00010000:3.0:1787075919.317794:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039600/0x859911ad6869f669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.317805:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190039600/0x859911ad6869f669 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.317812:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190039600/0x859911ad6869f669 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.317819:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190039600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075919.317824:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190039600/0x859911ad6869f669 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.317832:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190039600/0x859911ad6869f669 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.317844:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff996187c34800) 00010000:00010000:3.0:1787075919.317847:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075919.317865:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190039600/0x859911ad6869f669 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.317871:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190039600/0x859911ad6869f669 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075919.324103:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075919.324271:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678735488 00000100:00100000:3.0:1787075919.324282:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678735488 00000100:00100000:3.0:1787075919.324349:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:3.0:1787075919.324360:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+10:9680:x1873884678735488:12345-192.168.204.50@tcp:101:touch.500 00010000:00010000:3.0:1787075919.324387:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075919.324409:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6400/0x859911ad6869f685 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76233d1 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.324475:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6400/0x859911ad6869f685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233d1 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.324492:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6400/0x859911ad6869f685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233d1 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.324514:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff996191b79b00) 00010000:00010000:3.0:1787075919.324517:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787075919.324521:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996183be6400, rc 0) 00000100:00100000:3.0:1787075919.324602:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+11:9680:x1873884678735488:12345-192.168.204.50@tcp:101:touch.500 Request processed in 243us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075919.324609:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 24 00010000:00010000:2.0:1787075919.325836:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f67e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.325849:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f67e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.325856:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f67e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.325877:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075919.325882:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f67e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.325889:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f67e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.325904:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff996191b79b00) 00010000:00010000:2.0:1787075919.325907:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075919.325911:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f67e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.325917:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f67e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075919.327891:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075919.328025:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678735616 00000100:00100000:2.0:1787075919.328035:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678735616 00000100:00100000:2.0:1787075919.328088:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:2.0:1787075919.328096:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1873884678735616:12345-192.168.204.50@tcp:8:touch.500 00010000:00080000:2.0:1787075919.328131:0:6705:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:2.0:1787075919.328166:0:6705:0:(genops.c:1406:class_connect()) connect: client a850c61f-0242-4b36-8952-7b46dff1f2b9, cookie 0x859911ad6869f68c 00002000:00100000:2.0:1787075919.328179:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a850c61f-0242-4b36-8952-7b46dff1f2b9/ffff9961b521d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787075919.328207:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787075919.328790:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787075919.328826:0:6705:0:(import.c:65:import_set_state_nolock()) ffff9961b521e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787075919.328909:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2358:x1873884678735616:12345-192.168.204.50@tcp:8:touch.500 Request processed in 811us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075919.328943:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:0.0:1787075919.331709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075919.331847:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678735744 00000100:00100000:2.0:1787075919.331856:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678735744 00000100:00100000:2.0:1787075919.331921:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:2.0:1787075919.331941:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:0:x1873884678735744:12345-192.168.204.50@tcp:2:touch.500 00000100:00080000:3.0:1787075919.332530:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787075919.398884:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1787075919.398903:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a850c61f-0242-4b36-8952-7b46dff1f2b9 00000100:00100000:0.0:1787075919.399483:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:0:x1873884678735744:12345-192.168.204.50@tcp:2:touch.500 Request processed in 67535us (67775us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787075919.399498:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:1.0:1787075919.403898:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075919.404114:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678736000 00000100:00100000:3.0:1787075919.404134:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678736000 00000100:00100000:3.0:1787075919.404310:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:3.0:1787075919.404329:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+10:9680:x1873884678736000:12345-192.168.204.50@tcp:35:touch.500 00000100:00100000:3.0:1787075919.404966:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+11:9680:x1873884678736000:12345-192.168.204.50@tcp:35:touch.500 Request processed in 639us (1074us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787075919.404978:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:2.0:1787075919.427821:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075919.428443:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678736128 00000100:00100000:3.0:1787075919.428694:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678736128 00000100:00100000:3.0:1787075919.428783:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:3.0:1787075919.428797:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+11:9681:x1873884678736128:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:3.0:1787075919.428831:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075919.428861:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f693 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76233d8 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.429139:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6e00/0x859911ad6869f69a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.429159:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6e00/0x859911ad6869f69a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.429175:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6e00/0x859911ad6869f69a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075919.429282:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787075919.429288:0:5854:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787075919.429420:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6e00/0x859911ad6869f69a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.429462:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233d8 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.429518:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6e00/0x859911ad6869f69a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233d8 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.429529:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996187c34000) 00010000:00010000:3.0:1787075919.429533:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787075919.429539:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996183be6e00, rc 0) 00000100:00100000:3.0:1787075919.429764:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+12:9681:x1873884678736128:12345-192.168.204.50@tcp:101:rm.0 Request processed in 969us (1953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075919.429773:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:0.0:1787075919.433525:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075919.433679:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678736384 00000100:00100000:3.0:1787075919.433693:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678736384 00000100:00100000:3.0:1787075919.433776:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:3.0:1787075919.433793:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+12:9681:x1873884678736384:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:3.0:1787075919.433823:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075919.433864:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181497800/0x859911ad6869f6a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76233df expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075919.434075:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787075919.434358:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181497800/0x859911ad6869f6a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233df expref: 14 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.434380:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b79e00) 00010000:00010000:3.0:1787075919.434384:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787075919.434391:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181497800/0x859911ad6869f6a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233df expref: 14 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.434425:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181497800, rc 0) 00000100:00100000:3.0:1787075919.434535:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:9681:x1873884678736384:12345-192.168.204.50@tcp:101:rm.0 Request processed in 744us (1027us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1787075919.434545:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:1.0:1787075919.440000:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075919.440822:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678736512 00000100:00100000:2.0:1787075919.440839:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678736512 00000100:00100000:2.0:1787075919.440940:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:2.0:1787075919.440955:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:9681:x1873884678736512:12345-192.168.204.50@tcp:37:rm.0 00000100:00100000:0.0:1787075919.455369:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:9681:x1873884678736512:12345-192.168.204.50@tcp:37:rm.0 Request processed in 14403us (15374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075919.456191:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:0.0:1787075919.463812:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075919.463918:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678736768 00000100:00100000:3.0:1787075919.463953:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678736768 00000100:00100000:3.0:1787075919.464254:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:3.0:1787075919.464271:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619ce52850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:9681:x1873884678736768:12345-192.168.204.50@tcp:35:rm.0 00000100:00100000:3.0:1787075919.464821:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619ce52850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:9681:x1873884678736768:12345-192.168.204.50@tcp:35:rm.0 Request processed in 551us (1021us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787075919.464831:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:1.0:1787075919.468341:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075919.469096:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678737024 00000100:00100000:2.0:1787075919.469109:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678737024 00000100:00100000:2.0:1787075919.469179:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:2.0:1787075919.469191:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:9681:x1873884678737024:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:2.0:1787075919.469338:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075919.469365:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f6af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76233e6 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.469811:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032e00/0x859911ad6869f6b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.469827:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032e00/0x859911ad6869f6b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.469841:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032e00/0x859911ad6869f6b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075919.469879:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787075919.470378:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f6af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233e6 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.470401:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032e00/0x859911ad6869f6b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233e6 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.470410:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996187c34000) 00010000:00010000:2.0:1787075919.470412:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787075919.470416:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032e00, rc 0) 00000100:00100000:2.0:1787075919.470598:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+16:9681:x1873884678737024:12345-192.168.204.50@tcp:101:rm.0 Request processed in 1408us (2270us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787075919.470608:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:1.0:1787075919.482115:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075919.482271:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678737152 00000100:00100000:3.0:1787075919.482283:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678737152 00000100:00100000:3.0:1787075919.482357:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:3.0:1787075919.482371:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+16:9681:x1873884678737152:12345-192.168.204.50@tcp:41:rm.0 00000004:00000024:3.0:1787075919.482447:0:7654:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1787075919.482543:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+16:9681:x1873884678737152:12345-192.168.204.50@tcp:41:rm.0 Request processed in 176us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075919.482551:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:0.0:1787075919.499622:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075919.499862:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678737280 00000100:00100000:3.0:1787075919.499876:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678737280 00000100:00100000:3.0:1787075919.499967:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:3.0:1787075919.499980:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+16:9681:x1873884678737280:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:3.0:1787075919.500014:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075919.500045:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181497800/0x859911ad6869f6c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76233ed expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500132:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181496c00/0x859911ad6869f6cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500148:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181496c00/0x859911ad6869f6cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500161:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181496c00/0x859911ad6869f6cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500179:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f6d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500186:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500193:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500317:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869f6d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500326:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869f6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500334:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869f6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075919.500362:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787075919.500365:0:5854:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787075919.500382:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869f6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500399:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869f6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500407:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181496c00/0x859911ad6869f6cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500413:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181496c00/0x859911ad6869f6cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500420:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181496c00/0x859911ad6869f6cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500762:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181496c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075919.500767:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181496c00/0x859911ad6869f6cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500775:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181496c00/0x859911ad6869f6cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500788:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996187c34000) 00010000:00010000:3.0:1787075919.500791:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075919.500795:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181496c00/0x859911ad6869f6cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500801:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181496c00/0x859911ad6869f6cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500816:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500822:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f6d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500834:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f6d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500839:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996183be7400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075919.500842:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f6d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500847:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f6d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500854:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff996194304500) 00010000:00010000:3.0:1787075919.500856:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075919.500858:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f6d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.500865:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996183be7400/0x859911ad6869f6d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.501188:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181497800/0x859911ad6869f6c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233ed expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.501207:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869f6d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233ed expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.501216:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff996191b79b00) 00010000:00010000:3.0:1787075919.501218:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787075919.501221:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523a00, rc 0) 00000100:00100000:3.0:1787075919.501294:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+17:9681:x1873884678737280:12345-192.168.204.50@tcp:101:rm.0 Request processed in 1316us (1683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075919.501313:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:3.0:1787075919.508231:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075919.508938:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678737536 00000100:00100000:1.0:1787075919.508949:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678737536 00000100:00100000:1.0:1787075919.509019:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:1.0:1787075919.509027:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+17:9681:x1873884678737536:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:1.0:1787075919.509098:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787075919.509130:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869f6d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233ed expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.509151:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6400/0x859911ad6869f685 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233d1 expref: 16 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.509181:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff996191b79b00) 00010000:00010000:1.0:1787075919.509200:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996183be6e00/0x859911ad6869f69a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233d8 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.509207:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996187c34000) 00010000:00010000:1.0:1787075919.509211:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787075919.509234:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad6869f6e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.509248:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad6869f6e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.509258:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad6869f6e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.509271:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869f6e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.509277:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869f6e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.509284:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869f6e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.509422:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869f6ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.509431:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869f6ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.509451:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869f6ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787075919.511342:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787075919.511358:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 301486717429ns, next at 302486714596ns, rc = 0 00010000:00010000:1.0:1787075919.511435:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869f6f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.511449:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869f6f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.511460:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869f6f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.511468:0:7654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869f6f5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.511475:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869f6f5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.511481:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869f6f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.511510:0:7654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787075919.511726:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787075919.511733:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869f6f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.511741:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632000 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787075919.511745:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869f6f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.511753:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869f6f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.511766:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff996187c34d00) 00010000:00010000:2.0:1787075919.511769:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787075919.511774:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869f6f5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.511793:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869f6f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.511805:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075919.511807:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075919.511808:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075919.512401:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869f6ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.512412:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869f6ee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.512419:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869f6ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.512432:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075919.512436:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869f6ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.512442:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869f6ee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.512452:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff996187c34d00) 00010000:00010000:1.0:1787075919.512455:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787075919.512459:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869f6ee lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.512464:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869f6ee lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.512487:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad6869f6e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.512494:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad6869f6e0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.512500:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad6869f6e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.512504:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075919.512507:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad6869f6e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.512512:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad6869f6e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.512830:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996187c34000) 00010000:00010000:1.0:1787075919.512834:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075919.512838:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad6869f6e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.512845:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad6869f6e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787075919.512857:0:7654:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000b99528ee reply state 000000009aace2c2 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869f6e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075919.512868:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787075919.513267:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+16:9681:x1873884678737536:12345-192.168.204.50@tcp:36:rm.0 Request processed in 4231us (5038us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787075919.513278:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 30 00010000:00010000:3.0:1787075919.518696:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869f6e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.518716:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869f6e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.518725:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869f6e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.518732:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075919.518737:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869f6e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.518745:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869f6e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.518765:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff996187c34a00) 00010000:00010000:3.0:1787075919.518769:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075919.518774:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869f6e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075919.518781:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869f6e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075919.520438:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075919.521059:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678737792 00000100:00100000:2.0:1787075919.521078:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678737792 00000100:00100000:2.0:1787075919.521137:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:2.0:1787075919.521145:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+15:9681:x1873884678737792:12345-192.168.204.50@tcp:35:rm.0 00000100:00100000:2.0:1787075919.521441:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+16:9681:x1873884678737792:12345-192.168.204.50@tcp:35:rm.0 Request processed in 295us (1012us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787075919.521448:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:1.0:1787075919.528810:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075919.529076:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678738048 00000100:00100000:2.0:1787075919.529088:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678738048 00000100:00100000:2.0:1787075919.529148:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:2.0:1787075919.529157:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+16:9681:x1873884678738048:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:2.0:1787075919.529212:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787075919.529240:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032e00/0x859911ad6869f6b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233e6 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.529264:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad6869f654 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233c3 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.529276:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996187c34000) 00010000:00010000:2.0:1787075919.529291:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f615 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233b5 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.529317:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b79e00) 00010000:00010000:2.0:1787075919.529327:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787075919.529361:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f6fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.529374:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f6fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.529384:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f6fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.529397:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f703 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.529404:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f703 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.529410:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f703 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.529876:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033200/0x859911ad6869f70a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.530400:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033200/0x859911ad6869f70a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.530409:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033200/0x859911ad6869f70a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075919.532272:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787075919.532306:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033200/0x859911ad6869f70a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.532325:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033200/0x859911ad6869f70a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.532333:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033200/0x859911ad6869f70a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.532341:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9033200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075919.532346:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033200/0x859911ad6869f70a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.532353:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033200/0x859911ad6869f70a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.532373:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff996191b79b00) 00010000:00010000:2.0:1787075919.532377:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787075919.532381:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033200/0x859911ad6869f70a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.532387:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033200/0x859911ad6869f70a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.532421:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f6fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.532427:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f6fc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.532432:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f6fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.532437:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075919.532446:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f6fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.532452:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f6fc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.532459:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b79700) 00010000:00010000:2.0:1787075919.532462:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075919.532465:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f6fc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.532471:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f6fc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787075919.532487:0:5852:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000bb448445 reply state 0000000086e77b35 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f703 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075919.532499:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787075919.532636:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+15:9681:x1873884678738048:12345-192.168.204.50@tcp:36:rm.0 Request processed in 3473us (3832us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787075919.532672:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 31 00010000:00010000:2.0:1787075919.535587:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f703 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.535609:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f703 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.535617:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f703 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.535624:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075919.535629:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f703 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.535691:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f703 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.535710:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff996191b79a00) 00010000:00010000:2.0:1787075919.535714:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075919.535719:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f703 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075919.535724:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f703 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075919.752049:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787075920.583831:0:7837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 302559187842ns, next at 303559185523ns, rc = 0 00000100:00100000:0.0:1787075920.583889:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787075920.583917:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700788480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787075920.583982:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075920.584332:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700788480 00000100:00100000:1.0:1787075920.584340:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700788480 00000100:00100000:1.0:1787075920.584406:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787075920.584414:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700788480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787075920.584434:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075920.584473:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700788480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075920.584480:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787075920.584531:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787075920.584561:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961a6e47800 x1873884700788480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075920.584578:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700788480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787075920.584801:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700788736:0@lo:400:kworker.0 00000100:00100000:0.0:1787075920.584828:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075920.584847:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787075920.584851:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191940a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700788864:0@lo:400:kworker.0 00000100:00100000:0.0:1787075920.584868:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075920.584888:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700788736 00000100:00100000:0.0:1787075920.584892:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700788736 00000100:00100000:0.0:1787075920.584931:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700788864 00000100:00100000:0.0:1787075920.584934:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700788864 00000100:00100000:0.0:1787075920.584952:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787075920.584958:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700788736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075920.584989:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700788736:12345-0@lo:400:kworker.0 Request processed in 31us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075920.584995:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787075920.585006:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787075920.585011:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700788864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075920.585030:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700788864:12345-0@lo:400:kworker.0 Request processed in 20us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075920.585035:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1787075920.585068:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787075920.585084:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191940a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700788864:0@lo:400:kworker.0 00000100:00100000:0.0:1787075920.585092:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191943800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700788736:0@lo:400:kworker.0 00000100:00100000:1.0:1787075920.585236:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a53df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700788608:0@lo:400:kworker.0 00000100:00100000:1.0:1787075920.585271:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075920.585299:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873884700789120:0@lo:400:kworker.0 00000100:00100000:1.0:1787075920.585316:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075920.585328:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787075920.585332:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700788992:0@lo:400:kworker.0 00000100:00100000:1.0:1787075920.585350:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075920.585496:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700789120 00000100:00100000:2.0:1787075920.585501:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700789120 00000100:00100000:2.0:1787075920.585528:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787075920.585534:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873884700789120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075920.585568:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873884700789120:12345-0@lo:400:kworker.0 Request processed in 34us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075920.585574:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1787075920.585635:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787075920.585667:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873884700789120:0@lo:400:kworker.0 00000100:00100000:0.0:1787075920.586493:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700788608 00000100:00100000:0.0:1787075920.586504:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700788608 00000100:00100000:0.0:1787075920.586558:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787075920.586567:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700788608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075920.586669:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191063050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700788608:12345-0@lo:400:kworker.0 Request processed in 103us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075920.586676:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787075920.586714:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700788992 00000100:00100000:0.0:1787075920.586718:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700788992 00000100:00100000:0.0:1787075920.586823:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787075920.586830:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700788992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075920.586861:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700788992:12345-0@lo:400:kworker.0 Request processed in 32us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075920.586866:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787075920.587468:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996191941880 x1873884700788992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075920.587482:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700788992:0@lo:400:kworker.0 00000100:00100000:1.0:1787075920.587493:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a53df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700788608:0@lo:400:kworker.0 00000100:00080000:2.0:1787075920.589177:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787075920.777828:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075921.189345:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075921.189391:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075921.189430:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075921.189459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075921.189489:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678738304 00000100:00100000:1.0:1787075921.189499:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678738304 00000100:00100000:1.0:1787075921.189555:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678738560 00000100:00100000:1.0:1787075921.189559:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678738560 00000100:00100000:1.0:1787075921.189580:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 94 00000100:00100000:1.0:1787075921.189592:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:2360:x1873884678738304:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075921.189706:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:2360:x1873884678738304:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 116us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075921.189715:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 94 00000100:00100000:1.0:1787075921.189735:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 95 00000100:00100000:1.0:1787075921.189742:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2360:x1873884678738560:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075921.189779:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2360:x1873884678738560:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 38us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075921.189785:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 95 00000100:00080000:1.0:1787075921.189817:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075921.189909:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678738432 00000100:00100000:3.0:1787075921.189913:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678738432 00000100:00100000:3.0:1787075921.189956:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:3.0:1787075921.189964:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2360:x1873884678738432:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075921.190000:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2360:x1873884678738432:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 37us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075921.190007:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:0.0:1787075921.190355:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678738176 00000100:00100000:0.0:1787075921.190361:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678738176 00000100:00100000:0.0:1787075921.190400:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 244 00000100:00100000:0.0:1787075921.190408:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2360:x1873884678738176:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075921.190442:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191063c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2360:x1873884678738176:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 36us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075921.190448:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 244 00000100:00080000:1.0:1787075921.190931:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787075921.610574:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700789248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787075921.610749:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075921.611318:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700789248 00000100:00100000:2.0:1787075921.611329:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700789248 00000100:00100000:2.0:1787075921.611399:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787075921.611477:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700789248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787075921.611617:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075921.611709:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191943800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700789248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 300us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075921.611728:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1787075921.611869:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996184e06300 x1873884700789248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075921.611907:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700789248:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787075921.815791:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075922.825161:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075923.848734:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787075924.211288:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787075924.211315:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1787075924.211320:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787075924.211469:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700789376:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787075924.211560:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075924.211671:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700789376 00000100:00100000:2.0:1787075924.211679:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700789376 00000100:00100000:2.0:1787075924.211743:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787075924.211755:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700789376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787075924.211786:0:8477:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787075924.211821:0:8477:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a849d4f, atime: 0x6a849d4f, ctime: 0x6a849d4f, blocks: 0x1 00010000:00010000:2.0:1787075924.211839:0:8477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869f711 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075924.211854:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=306s v=(0 0) 00010000:00010000:2.0:1787075924.211858:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787075924.211864:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869f711 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075924.211883:0:8477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869f711 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075924.211894:0:8477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869f711 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075924.211914:0:8477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869f711 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075924.211931:0:8477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:0.0:1787075924.212472:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:2.0:1787075924.212896:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1873884700789376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1142us (1335us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787075924.212906:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787075924.212940:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787075924.212955:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787075924.212961:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869f711 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787075924.213150:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9961b516f800/2, rc 0, transno 4294967300 00000100:00100000:0.0:1787075924.213157:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700789376:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787075924.213190:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032400 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787075924.213196:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869f711 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075924.213207:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869f711 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075924.213227:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869f711 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075924.213235:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869f711 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075924.213270:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075924.213272:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075924.213274:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787075924.224154:0:11629:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:1.0:1787075924.797273:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1787075924.872407:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787075925.545214:0:11678:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7cf6c400 20000000:00000080:0.0:1787075925.545237:0:11678:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9961bf626800 uarg=0000000000000000 20000000:01000000:0.0:1787075925.545275:0:11678:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787075925.545282:0:11678:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787075925.545289:0:11678:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787075925.546155:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787075925.546307:0:11678:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787075925.556250:0:11678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787075925.556310:0:11678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787075925.556371:0:11678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787075925.556391:0:11678:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787075925.556413:0:11678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9961bfe68600/0x859911ad6869f718 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075925.556434:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181497600/0x859911ad6869f5b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233a0 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075925.556441:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181497c00/0x859911ad6869f5ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233a7 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075925.556449:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181496200/0x859911ad6869f5c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f5c1 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075925.556464:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9961b9032000/0x859911ad6869f5d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f5cf expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075925.556471:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9961b9033600/0x859911ad6869f5e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f5dd expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075925.556479:0:11678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9961bfe68600/0x859911ad6869f718 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075925.556525:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9961b9033600/0x859911ad6869f5e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f5dd expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075925.556542:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9961b9033600/0x859911ad6869f5e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f5dd expref: 18 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075925.556559:0:11678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191940a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873884700789504:0@lo:104: 00000100:00100000:0.0:1787075925.556623:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787075925.557010:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9961b9032000/0x859911ad6869f5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f5cf expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075925.557020:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9961b9032000/0x859911ad6869f5d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f5cf expref: 18 pid: 5847 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075925.557030:0:11678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191941180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873884700789632:0@lo:104: 00000100:00100000:0.0:1787075925.557054:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075925.557082:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700789504 00000100:00100000:0.0:1787075925.557089:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700789504 00000100:00100000:0.0:1787075925.557126:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700789632 00000100:00100000:0.0:1787075925.557130:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700789632 00000100:00100000:0.0:1787075925.557156:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787075925.557164:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191942d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+4:11678:x1873884700789504:12345-0@lo:104: 00010000:00010000:0.0:1787075925.557177:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9961b9033c00/0x859911ad6869f5dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f5e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075925.557223:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787075925.557229:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191942d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+4:11678:x1873884700789504:12345-0@lo:104: Request processed in 66us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075925.557236:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787075925.557251:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787075925.557256:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191942300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:11678:x1873884700789632:12345-0@lo:104: 00010000:00010000:0.0:1787075925.557262:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996181497400/0x859911ad6869f5cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f5d6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075925.557290:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787075925.557295:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191942300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:11678:x1873884700789632:12345-0@lo:104: Request processed in 40us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075925.557300:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1787075925.557326:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181496200/0x859911ad6869f5c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad6869f5c1 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075925.557335:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff996181496200/0x859911ad6869f5c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad6869f5c1 expref: 18 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075925.557343:0:11678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191940380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873884700789760:0@lo:104: 00000100:00100000:0.0:1787075925.557365:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075925.557390:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787075925.557399:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700789760 00000100:00100000:0.0:1787075925.557406:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700789760 00000100:00100000:0.0:1787075925.557425:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787075925.557431:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b5200450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:11678:x1873884700789760:12345-0@lo:104: 00010000:00010000:0.0:1787075925.557438:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996183be6c00/0x859911ad6869f5c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f5c8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075925.557462:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787075925.557467:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b5200450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+3:11678:x1873884700789760:12345-0@lo:104: Request processed in 37us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075925.557472:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1787075925.557515:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181497c00/0x859911ad6869f5ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233a7 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075925.557526:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996181497c00/0x859911ad6869f5ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233a7 expref: 12 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075925.557535:0:11678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191942d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873884700789888:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787075925.557585:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181497600/0x859911ad6869f5b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233a0 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075925.557593:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996181497600/0x859911ad6869f5b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233a0 expref: 12 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075925.557601:0:11678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191942300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873884700790016:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787075925.557621:0:11678:0:(client.c:2702:ptlrpc_set_wait()) set ffff996185caa540 going to sleep for 11 seconds 00000100:00100000:0.0:1787075925.557663:0:11678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191940a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873884700789504:0@lo:104: 00000100:00100000:0.0:1787075925.557672:0:11678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191941180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873884700789632:0@lo:104: 00000100:00100000:0.0:1787075925.557679:0:11678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191940380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873884700789760:0@lo:104: 00010000:00010000:2.0:1787075925.557981:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787075925.557988:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9961b9033c00/0x859911ad6869f5dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f5e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.557997:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9033c00 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:2.0:1787075925.558001:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9961b9033c00/0x859911ad6869f5dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f5e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.558009:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9961b9033c00/0x859911ad6869f5dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f5e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787075925.558016:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9961b9033c00/0x859911ad6869f5dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f5e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787075925.558022:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787075925.558051:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9961b9033c00/0x859911ad6869f5dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f5e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.558057:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787075925.558080:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9961b9033c00/0x859911ad6869f5dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f5e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.558087:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9961b9033c00/0x859911ad6869f5dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f5e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.558112:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787075925.558116:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181497400/0x859911ad6869f5cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f5d6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.558122:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181497400 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:2.0:1787075925.558125:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181497400/0x859911ad6869f5cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f5d6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.558131:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181497400/0x859911ad6869f5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f5d6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787075925.558137:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181497400/0x859911ad6869f5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f5d6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787075925.558142:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787075925.558156:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181497400/0x859911ad6869f5cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f5d6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.558162:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787075925.558167:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181497400/0x859911ad6869f5cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f5d6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.558173:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181497400/0x859911ad6869f5cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f5d6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.558182:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787075925.558185:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996183be6c00/0x859911ad6869f5c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad6869f5c8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.558200:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996183be6c00 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:2.0:1787075925.558204:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996183be6c00/0x859911ad6869f5c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad6869f5c8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.558211:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996183be6c00/0x859911ad6869f5c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad6869f5c8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787075925.558216:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996183be6c00/0x859911ad6869f5c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad6869f5c8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787075925.558220:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787075925.558233:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996183be6c00/0x859911ad6869f5c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f5c8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.558239:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787075925.558254:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996183be6c00/0x859911ad6869f5c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f5c8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.558261:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996183be6c00/0x859911ad6869f5c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad6869f5c8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.558287:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075925.558289:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075925.558291:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075925.558311:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700790144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787075925.558344:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075925.558375:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787075925.558381:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700790272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787075925.558412:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075925.558439:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700790400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787075925.558461:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075925.558492:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700790144 00000100:00100000:2.0:1787075925.558497:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700790144 00010000:00010000:2.0:1787075925.558520:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9961b9033600/0x859911ad6869f5e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f5dd expref: 19 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075925.558543:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700790272 00000100:00100000:2.0:1787075925.558546:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700790272 00010000:00010000:2.0:1787075925.558558:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9961b9032000/0x859911ad6869f5d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f5cf expref: 20 pid: 5847 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075925.558568:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700790400 00000100:00100000:2.0:1787075925.558571:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700790400 00010000:00010000:2.0:1787075925.558581:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181496200/0x859911ad6869f5c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f5c1 expref: 21 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075925.558594:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787075925.558602:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+21:3313:x1873884700790144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787075925.558614:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075925.558620:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9961b9033600/0x859911ad6869f5e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f5dd expref: 21 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.558631:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9961b9033600/0x859911ad6869f5e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f5dd expref: 21 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.558664:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961b9033600/0x859911ad6869f5e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f5dd expref: 21 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.558969:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075925.559006:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+20:3313:x1873884700790144:12345-0@lo:103:ldlm_bl.0 Request processed in 404us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075925.559013:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787075925.559031:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787075925.559038:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700790272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787075925.559046:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075925.559050:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9961b9032000/0x859911ad6869f5d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f5cf expref: 19 pid: 5847 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.559058:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9961b9032000/0x859911ad6869f5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f5cf expref: 19 pid: 5847 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.559067:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961b9032000/0x859911ad6869f5d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f5cf expref: 19 pid: 5847 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.559076:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075925.559096:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:3313:x1873884700790272:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075925.559103:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787075925.559114:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787075925.559120:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a03cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:3311:x1873884700790400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787075925.559128:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075925.559132:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181496200/0x859911ad6869f5c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad6869f5c1 expref: 17 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.559141:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181496200/0x859911ad6869f5c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad6869f5c1 expref: 17 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.559157:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181496200/0x859911ad6869f5c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad6869f5c1 expref: 17 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.559167:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075925.559194:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a03cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:3311:x1873884700790400:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075925.559201:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787075925.559267:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700790400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787075925.559290:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700790272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787075925.559298:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700790144:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787075925.559466:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787075925.565550:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075925.565809:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678738688 00000100:00100000:2.0:1787075925.565820:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678738688 00010000:00010000:2.0:1787075925.565875:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181497c00/0x859911ad6869f5ba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233a7 expref: 13 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075925.565924:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:2.0:1787075925.565935:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2361:x1873884678738688:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075925.565961:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075925.565969:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181497c00/0x859911ad6869f5ba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233a7 expref: 13 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.565981:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181497c00/0x859911ad6869f5ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233a7 expref: 13 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.566006:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075925.566064:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2361:x1873884678738688:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 131us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075925.566087:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:3.0:1787075925.566675:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075925.567079:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678738816 00000100:00100000:2.0:1787075925.567088:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678738816 00010000:00010000:2.0:1787075925.567118:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181497600/0x859911ad6869f5b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233a0 expref: 13 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075925.567148:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:2.0:1787075925.567156:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2362:x1873884678738816:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075925.567168:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075925.567174:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181497600/0x859911ad6869f5b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233a0 expref: 13 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.567185:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181497600/0x859911ad6869f5b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233a0 expref: 13 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.567202:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9961bfe68600/0x859911ad6869f718 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.567211:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961bfe68600/0x859911ad6869f718 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.567225:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9961bfe68600/0x859911ad6869f718 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.567232:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9961bfe68600/0x859911ad6869f718 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.567239:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9961bfe68600/0x859911ad6869f718 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.567261:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9961bfe68600/0x859911ad6869f718 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.567268:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68600 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787075925.567272:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9961bfe68600/0x859911ad6869f718 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.567280:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9961bfe68600/0x859911ad6869f718 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.567290:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9961bfe68600/0x859911ad6869f718 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075925.567300:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075925.567348:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2362:x1873884678738816:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 192us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075925.567356:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00010000:00010000:0.0:1787075925.568387:0:11678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181497c00/0x859911ad6869f5ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233a7 expref: 12 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075925.568403:0:11678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191942d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873884700789888:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787075925.568542:0:11678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181497600/0x859911ad6869f5b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233a0 expref: 11 pid: 5846 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075925.568552:0:11678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191942300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873884700790016:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787075925.568584:0:11678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9961bfe68600/0x859911ad6869f718 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075925.568593:0:11678:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9961bfe68600/0x859911ad6869f718 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075925.568598:0:11678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9961bfe68600/0x859911ad6869f718 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075925.568604:0:11678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961bfe68600/0x859911ad6869f718 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075925.703947:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700790528:0@lo:400:kworker.0 00000100:00100000:1.0:1787075925.704063:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075925.704139:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700791040:0@lo:400:kworker.0 00000100:00100000:1.0:1787075925.704177:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075925.704216:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787075925.704223:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700790912:0@lo:400:kworker.0 00000100:00100000:1.0:1787075925.704247:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075925.704283:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700790656:0@lo:400:kworker.0 00000100:00100000:1.0:1787075925.704307:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075925.704494:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787075925.704503:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700790784:0@lo:400:kworker.0 00000100:00100000:1.0:1787075925.704532:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075925.704574:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700790528 00000100:00100000:1.0:1787075925.704583:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700790528 00000100:00100000:1.0:1787075925.704632:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700790912 00000100:00100000:1.0:1787075925.704634:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700790912 00000100:00100000:1.0:1787075925.704691:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700790656 00000100:00100000:1.0:1787075925.704694:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700790656 00000100:00100000:1.0:1787075925.704716:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787075925.704725:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700790528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075925.704783:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700790528:12345-0@lo:400:kworker.0 Request processed in 59us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075925.704792:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787075925.704822:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787075925.704830:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700790912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075925.705219:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700790912:12345-0@lo:400:kworker.0 Request processed in 390us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075925.705226:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787075925.705239:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787075925.705246:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700790656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075925.705287:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700790656:12345-0@lo:400:kworker.0 Request processed in 43us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075925.705293:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787075925.705313:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700791040 00000100:00100000:1.0:1787075925.705317:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700791040 00000100:00100000:1.0:1787075925.705355:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700790784 00000100:00100000:1.0:1787075925.705358:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700790784 00000100:00100000:1.0:1787075925.705385:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787075925.705394:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700791040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075925.705430:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700791040:12345-0@lo:400:kworker.0 Request processed in 40us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075925.705437:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787075925.705452:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787075925.705459:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700790784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075925.705488:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700790784:12345-0@lo:400:kworker.0 Request processed in 31us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075925.705494:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1787075925.705536:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787075925.705544:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787075925.705591:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996184e05880 x1873884700790784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075925.705608:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700790784:0@lo:400:kworker.0 00000100:00100000:1.0:1787075925.705620:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700790656:0@lo:400:kworker.0 00000100:00100000:1.0:1787075925.705717:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700790912:0@lo:400:kworker.0 00000100:00100000:1.0:1787075925.705731:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700790528:0@lo:400:kworker.0 00000100:00100000:1.0:1787075925.705755:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1787075925.705761:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9961b516f800, transno 4294967300 00000100:00100000:1.0:1787075925.705776:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700791040:0@lo:400:kworker.0 00000100:00100000:3.0:1787075925.706075:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787075925.706086:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700791168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787075925.706122:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075925.706161:0:9220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700791168 00000100:00100000:3.0:1787075925.706165:0:9220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700791168 00000100:00100000:3.0:1787075925.706193:0:9220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787075925.706199:0:9220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700791168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787075925.706225:0:9220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787075925.706258:0:9220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700791168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075925.706264:0:9220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787075925.706297:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700791168:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787075925.905697:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787075926.309106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075926.309158:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075926.309202:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678739072 00000100:00100000:1.0:1787075926.309213:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678739072 00000100:00100000:3.0:1787075926.309220:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075926.309271:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075926.309282:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678739328 00000100:00100000:1.0:1787075926.309286:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678739328 00000100:00100000:3.0:1787075926.309325:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 99 00000100:00100000:1.0:1787075926.309334:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 100 00000100:00100000:3.0:1787075926.309340:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678739072:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075926.309348:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2362:x1873884678739328:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075926.309455:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678738944 00000100:00100000:0.0:1787075926.309460:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678738944 00000100:00100000:0.0:1787075926.309492:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 245 00000100:00100000:0.0:1787075926.309498:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+11:2362:x1873884678738944:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075926.309547:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678739072:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 212us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075926.309584:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 99 00000100:00080000:3.0:1787075926.309607:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075926.309630:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678739200 00000100:00100000:3.0:1787075926.309634:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678739200 00000100:00100000:3.0:1787075926.309694:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:3.0:1787075926.309712:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678739200:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075926.309771:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2362:x1873884678739328:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 427us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075926.309778:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 100 00000100:00080000:2.0:1787075926.312465:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787075926.315536:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191063450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+11:2362:x1873884678738944:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 6021us (6300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075926.315553:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 245 00000100:00100000:3.0:1787075926.316543:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678739200:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 6830us (7260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075926.316568:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:0.0:1787075926.731469:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787075926.731495:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700791296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787075926.731589:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075926.731850:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700791296 00000100:00100000:1.0:1787075926.731859:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700791296 00000100:00100000:1.0:1787075926.731917:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787075926.731938:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700791296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787075926.731985:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075926.732045:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700791296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075926.732052:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1787075926.732234:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996184e67100 x1873884700791296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075926.732252:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700791296:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787075926.919889:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787075927.175805:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787075927.175815:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9961bf681000 from 7 10000000:01000000:2.0:1787075927.175820:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787075927.175876:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033600/0x859911ad6869f71f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075927.175891:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9961b9033600/0x859911ad6869f71f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075927.175905:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9961b9033600/0x859911ad6869f71f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075927.175966:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700791424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787075927.176045:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075927.176123:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618773dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787075927.182512:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700791424 00000100:00100000:3.0:1787075927.182531:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700791424 00000100:00100000:3.0:1787075927.182618:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787075927.182631:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:5849:x1873884700791424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787075927.182678:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075927.182701:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181523c00/0x859911ad6869f726 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f71f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075927.182744:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181523c00/0x859911ad6869f726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f71f expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075927.182758:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181523c00/0x859911ad6869f726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f71f expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075927.182778:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523c00, rc 0) 00000100:00100000:3.0:1787075927.182888:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191060050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700791424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 260us (6843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075927.182896:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787075927.183526:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700791424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787075927.183548:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9961b9033600/0x859911ad6869f71f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f726 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075927.183559:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9961b9033600/0x859911ad6869f71f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f726 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075927.183632:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700791552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787075927.183737:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075927.183785:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618773dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075927.183902:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700791552 00000100:00100000:0.0:1787075927.183908:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700791552 00000100:00100000:0.0:1787075927.183962:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787075927.183971:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700791552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787075927.184255:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700791552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 284us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075927.184263:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787075927.185028:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700791552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787075927.185076:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700791680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075927.185128:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075927.185165:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618773dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075927.185224:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700791680 00000100:00100000:0.0:1787075927.185238:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700791680 00000100:00100000:0.0:1787075927.185283:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787075927.185291:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700791680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787075927.185475:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700791680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075927.185482:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787075927.185677:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700791680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075927.186452:0:11691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:11691:1873884700791808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787075927.186505:0:11691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075927.186540:0:11691:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618773db40 going to sleep for 11 seconds 00000100:00100000:3.0:1787075927.186590:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700791808 00000100:00100000:3.0:1787075927.186597:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700791808 00000100:00100000:3.0:1787075927.186636:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787075927.186669:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619102a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:11691:x1873884700791808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787075927.186999:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619102a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:11691:x1873884700791808:12345-0@lo:502:llog_process_th.0 Request processed in 331us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075927.187006:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787075927.188060:0:11691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:11691:1873884700791808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787075927.188108:0:11691:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787075927.188120:0:11691:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787075927.188123:0:11691:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787075927.188134:0:11691:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9961bf681000 00000020:00000080:2.0:1787075927.188137:0:11691:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787075927.188224:0:11691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:11691:1873884700791936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787075927.188283:0:11691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075927.188323:0:11691:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618773db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787075927.188816:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700791936 00000100:00100000:0.0:1787075927.188824:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700791936 00000100:00100000:0.0:1787075927.188873:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787075927.188881:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619102b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:11691:x1873884700791936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787075927.190892:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619102b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:11691:x1873884700791936:12345-0@lo:502:llog_process_th.0 Request processed in 2002us (2600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075927.190906:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787075927.192525:0:11691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:11691:1873884700791936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787075927.192575:0:11691:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787075927.192587:0:11691:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787075927.192590:0:11691:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787075927.192596:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787075927.206048:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787075927.206097:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787075927.206113:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033600/0x859911ad6869f71f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f726 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075927.206130:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961b9033600/0x859911ad6869f71f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f726 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787075927.206153:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787075927.206156:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9961c14da000 from 7 10000000:01000000:1.0:1787075927.206159:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787075927.206204:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bf633a00/0x859911ad6869f72d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075927.206214:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9961bf633a00/0x859911ad6869f72d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075927.206226:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9961bf633a00/0x859911ad6869f72d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075927.206258:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700792064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787075927.206337:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075927.206513:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff996182d69180 going to sleep for 11 seconds 00000100:00100000:0.0:1787075927.218078:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700792064 00000100:00100000:0.0:1787075927.218095:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700792064 00000100:00100000:0.0:1787075927.221018:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787075927.221047:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619102bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:5849:x1873884700792064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787075927.221077:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075927.221103:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961bfe69200/0x859911ad6869f734 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f72d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075927.221143:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961bfe69200/0x859911ad6869f734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f72d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075927.221165:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961bfe69200/0x859911ad6869f734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f72d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075927.221176:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe69200, rc 0) 00000100:00100000:0.0:1787075927.221277:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619102bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700792064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 242us (14939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075927.221283:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787075927.221435:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700792064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787075927.221455:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9961bf633a00/0x859911ad6869f72d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f734 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075927.221465:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9961bf633a00/0x859911ad6869f72d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f734 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075927.221549:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700792192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787075927.221591:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075927.231566:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618773db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787075927.235948:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700792192 00000100:00100000:0.0:1787075927.235966:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700792192 00000100:00100000:0.0:1787075927.236045:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787075927.236055:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619102b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700792192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787075927.238135:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619102b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700792192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2069us (16531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075927.238152:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787075927.238333:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700792192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787075927.238409:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700792320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787075927.238469:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075927.238502:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961866a13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787075927.238684:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700792320 00000100:00100000:2.0:1787075927.238692:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700792320 00000100:00100000:2.0:1787075927.238741:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787075927.238750:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700792320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075927.238969:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700792320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075927.238977:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787075927.239025:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700792320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787075927.240400:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787075927.244026:0:11695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:11695:1873884700792448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787075927.244127:0:11695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075927.244173:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700792448 00000100:00100000:3.0:1787075927.244180:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700792448 00000100:00100000:3.0:1787075927.244224:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787075927.244233:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:11695:x1873884700792448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787075927.245551:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:11695:x1873884700792448:12345-0@lo:502:llog_process_th.0 Request processed in 1311us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075927.245564:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787075927.245661:0:11695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961866a1840 going to sleep for 11 seconds 00000100:00100000:3.0:1787075927.245686:0:11695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:11695:1873884700792448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787075927.248629:0:11695:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787075927.248678:0:11695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787075927.248680:0:11695:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787075927.248689:0:11695:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9961c14da000 00000020:00000080:3.0:1787075927.248692:0:11695:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787075927.248853:0:11695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:11695:1873884700792576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787075927.248960:0:11695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075927.249013:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700792576 00000100:00100000:3.0:1787075927.249021:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700792576 00000100:00100000:3.0:1787075927.249070:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787075927.249078:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:11695:x1873884700792576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787075927.257493:0:11695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961879df180 going to sleep for 11 seconds 00000100:00100000:3.0:1787075927.263043:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:11695:x1873884700792576:12345-0@lo:502:llog_process_th.0 Request processed in 13957us (14075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075927.263059:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787075927.263148:0:11695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:11695:1873884700792576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787075927.263183:0:11695:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787075927.263191:0:11695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787075927.263193:0:11695:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787075927.263198:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787075927.263544:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787075927.263567:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787075927.263578:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bf633a00/0x859911ad6869f72d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f734 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075927.263590:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961bf633a00/0x859911ad6869f72d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f734 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787075927.263602:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787075927.263604:0:5849:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9961a03a5800 from 7 10000000:01000000:0.0:1787075927.263607:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787075927.263679:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe69000/0x859911ad6869f73b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075927.263688:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9961bfe69000/0x859911ad6869f73b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075927.263698:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9961bfe69000/0x859911ad6869f73b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075927.265091:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191940700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700792704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787075927.265181:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075927.265229:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961866a1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787075927.265950:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700792704 00000100:00100000:1.0:1787075927.265962:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700792704 00000100:00100000:1.0:1787075927.266020:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787075927.266031:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:5849:x1873884700792704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787075927.266051:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075927.266071:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961bf632200/0x859911ad6869f742 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad6869f73b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075927.266101:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961bf632200/0x859911ad6869f742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad6869f73b expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075927.266113:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961bf632200/0x859911ad6869f742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad6869f73b expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075927.266140:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632200, rc 0) 00000100:00100000:1.0:1787075927.266204:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700792704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075927.266210:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787075927.266510:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191940700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700792704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787075927.266530:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9961bfe69000/0x859911ad6869f73b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f742 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075927.266553:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9961bfe69000/0x859911ad6869f73b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f742 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075927.266623:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700792832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787075927.266669:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075927.266694:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618773dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787075927.266845:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700792832 00000100:00100000:3.0:1787075927.266850:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700792832 00000100:00100000:3.0:1787075927.266891:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787075927.266899:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700792832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787075927.269251:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700792832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2341us (2569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075927.269276:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787075927.269729:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700792832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787075927.269792:0:5849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700792960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075927.269846:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075927.269877:0:5849:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618773dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787075927.270131:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700792960 00000100:00100000:1.0:1787075927.270139:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700792960 00000100:00100000:1.0:1787075927.270188:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787075927.270197:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700792960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787075927.270363:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:5849:x1873884700792960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075927.270371:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787075927.271668:0:5849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f837e7e9-66a9-4dbd-86cd-a110c11486d7:5849:1873884700792960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075927.287937:0:11696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc35f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:11696:1873884700793088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787075927.288029:0:11696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075927.288077:0:11696:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618773d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787075927.288090:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700793088 00000100:00100000:0.0:1787075927.288098:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700793088 00000100:00100000:0.0:1787075927.288154:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787075927.288163:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:11696:x1873884700793088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787075927.288388:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:11696:x1873884700793088:12345-0@lo:502:llog_process_th.0 Request processed in 226us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075927.288397:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787075927.290219:0:11696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc35f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:11696:1873884700793088:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787075927.290275:0:11696:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787075927.290294:0:11696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787075927.290297:0:11696:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787075927.290303:0:11696:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9961a03a5800 00000020:00000080:2.0:1787075927.290307:0:11696:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787075927.290415:0:11696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc35f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:11696:1873884700793216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787075927.290495:0:11696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075927.290548:0:11696:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618773d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787075927.290834:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700793216 00000100:00100000:0.0:1787075927.290841:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700793216 00000100:00100000:0.0:1787075927.290892:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787075927.290902:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:11696:x1873884700793216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787075927.291145:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:11696:x1873884700793216:12345-0@lo:502:llog_process_th.0 Request processed in 243us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075927.291152:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787075927.292055:0:11696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc35f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f837e7e9-66a9-4dbd-86cd-a110c11486d7:11696:1873884700793216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787075927.292097:0:11696:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787075927.292105:0:11696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787075927.292107:0:11696:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787075927.292112:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787075927.292512:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787075927.292531:0:5849:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787075927.292544:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe69000/0x859911ad6869f73b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f742 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075927.292557:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961bfe69000/0x859911ad6869f73b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f742 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075927.392237:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075927.392549:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678739456 00000100:00100000:2.0:1787075927.392560:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678739456 00000100:00100000:2.0:1787075927.392624:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 261 00000100:00100000:2.0:1787075927.392634:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+11:5602:x1873884678739456:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787075927.392671:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075927.392692:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961b9033c00/0x859911ad6869f749 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76233f4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075927.392722:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961b9033c00/0x859911ad6869f749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233f4 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075927.392733:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961b9033c00/0x859911ad6869f749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233f4 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075927.392743:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9033c00, rc 0) 00000100:00100000:2.0:1787075927.392815:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:5602:x1873884678739456:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 181us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075927.392823:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 261 00000100:00100000:1.0:1787075927.437591:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075927.437725:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678739584 00000100:00100000:3.0:1787075927.437735:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678739584 00000100:00100000:3.0:1787075927.437807:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 262 00000100:00100000:3.0:1787075927.437818:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:5602:x1873884678739584:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787075927.438182:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:5602:x1873884678739584:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 364us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075927.438190:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 262 00000100:00100000:2.0:1787075927.448397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075927.448550:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678739712 00000100:00100000:1.0:1787075927.448563:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678739712 00000100:00100000:1.0:1787075927.448628:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 263 00000100:00100000:1.0:1787075927.448673:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:5602:x1873884678739712:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787075927.448929:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:5602:x1873884678739712:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 291us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075927.448938:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 263 00000100:00100000:1.0:1787075927.467728:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075927.468275:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678739840 00000100:00100000:2.0:1787075927.468289:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678739840 00000100:00100000:2.0:1787075927.468366:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 264 00000100:00100000:2.0:1787075927.468387:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:9951:x1873884678739840:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787075927.468700:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:9951:x1873884678739840:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 324us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075927.468717:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 264 00000100:00100000:0.0:1787075927.484832:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075927.485521:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678739968 00000100:00100000:3.0:1787075927.485539:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678739968 00000100:00100000:3.0:1787075927.485611:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 265 00000100:00100000:3.0:1787075927.485621:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:9951:x1873884678739968:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787075927.496840:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:9951:x1873884678739968:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 11207us (12010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075927.496858:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 265 00000100:00100000:3.0:1787075927.516759:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075927.517397:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678740096 00000100:00100000:1.0:1787075927.517411:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678740096 00000100:00100000:1.0:1787075927.517485:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 266 00000100:00100000:1.0:1787075927.517496:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+12:5602:x1873884678740096:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787075927.517533:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075927.517556:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961bf633e00/0x859911ad6869f750 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76233fb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075927.517592:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961bf633e00/0x859911ad6869f750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233fb expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075927.517604:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961bf633e00/0x859911ad6869f750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233fb expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075927.517613:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf633e00, rc 0) 00000100:00100000:1.0:1787075927.517696:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:5602:x1873884678740096:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 202us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075927.517704:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 266 00000100:00100000:1.0:1787075927.523023:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075927.523163:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678740224 00000100:00100000:0.0:1787075927.523173:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678740224 00000100:00100000:0.0:1787075927.523226:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 267 00000100:00100000:0.0:1787075927.523235:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:5602:x1873884678740224:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787075927.523550:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:5602:x1873884678740224:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 315us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075927.523559:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 267 00000100:00100000:0.0:1787075927.555151:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075927.555266:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678740352 00000100:00100000:2.0:1787075927.555278:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678740352 00000100:00100000:2.0:1787075927.555335:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 268 00000100:00100000:2.0:1787075927.555346:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:5602:x1873884678740352:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787075927.555850:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:5602:x1873884678740352:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 503us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075927.555860:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 268 00000100:00100000:3.0:1787075927.574371:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075927.574671:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678740480 00000100:00100000:1.0:1787075927.574683:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678740480 00000100:00100000:1.0:1787075927.574741:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 269 00000100:00100000:1.0:1787075927.574754:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:9954:x1873884678740480:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787075927.575060:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:9954:x1873884678740480:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 308us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075927.575068:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 269 00000100:00100000:1.0:1787075927.596173:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075927.596295:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678740608 00000100:00100000:0.0:1787075927.596310:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678740608 00000100:00100000:0.0:1787075927.596393:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 270 00000100:00100000:0.0:1787075927.596405:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:9954:x1873884678740608:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787075927.596770:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:9954:x1873884678740608:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 358us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075927.596780:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 270 00010000:00010000:2.0:1787075927.946220:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787075928.270274:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787075928.967898:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075929.991931:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075930.824165:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700793344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075930.824246:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075930.824369:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700793472:0@lo:400:kworker.0 00000100:00100000:0.0:1787075930.824419:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075930.824463:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700793472 00000100:00100000:2.0:1787075930.824471:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700793472 00000100:00100000:0.0:1787075930.824486:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700793984:0@lo:400:kworker.0 00000100:00100000:0.0:1787075930.824513:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075930.824541:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787075930.824546:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787075930.824555:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3312:x1873884700793472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075930.824556:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700793856:0@lo:400:kworker.0 00000100:00100000:0.0:1787075930.824600:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075930.824621:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3312:x1873884700793472:12345-0@lo:400:kworker.0 Request processed in 69us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075930.824629:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787075930.824637:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700793472:0@lo:400:kworker.0 00000100:00100000:0.0:1787075930.824715:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700793600:0@lo:400:kworker.0 00000100:00100000:2.0:1787075930.824722:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873884700793728:0@lo:400:kworker.0 00000100:00100000:0.0:1787075930.824747:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075930.824773:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700793984 00000100:00100000:2.0:1787075930.824778:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700793984 00000100:00100000:2.0:1787075930.824815:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700793600 00000100:00100000:2.0:1787075930.824819:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700793600 00000100:00100000:2.0:1787075930.824840:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787075930.824846:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700793984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075930.828745:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700793344 00000100:00100000:3.0:1787075930.828761:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700793344 00000100:00100000:3.0:1787075930.828845:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787075930.828856:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700793344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787075930.828896:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075930.829330:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700793856 00000100:00100000:1.0:1787075930.829337:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700793856 00000100:00100000:1.0:1787075930.829376:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787075930.829383:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700793856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075930.829467:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700793856:12345-0@lo:400:kworker.0 Request processed in 84us (4866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075930.829475:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787075930.829503:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787075930.829513:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700793600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075930.829546:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700793600:12345-0@lo:400:kworker.0 Request processed in 35us (4800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075930.829552:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787075930.829628:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075930.829678:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700793728 00000100:00100000:1.0:1787075930.829682:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700793728 00000100:00100000:1.0:1787075930.829711:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787075930.829717:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873884700793728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075930.829752:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873884700793728:12345-0@lo:400:kworker.0 Request processed in 35us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075930.829757:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787075930.829798:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873884700793728:0@lo:400:kworker.0 00010000:00080000:1.0:1787075930.829846:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961bfc34a80 x1873884700793856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075930.829858:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700793856:0@lo:400:kworker.0 00000100:00080000:1.0:1787075930.829890:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787075930.829896:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787075930.829918:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787075930.832330:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700793600:0@lo:400:kworker.0 00000100:00100000:3.0:1787075930.832341:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700793344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3469us (8076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075930.832351:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700794112:0@lo:400:kworker.0 00000100:00100000:3.0:1787075930.832357:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787075930.832385:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700793344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787075930.832394:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075930.832433:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700794112 00000100:00100000:3.0:1787075930.832441:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700794112 00000100:00100000:3.0:1787075930.832491:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787075930.832521:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700794112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075930.832613:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700794112:12345-0@lo:400:kworker.0 Request processed in 112us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075930.832619:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787075930.833056:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700794112:0@lo:400:kworker.0 00000100:00100000:2.0:1787075930.833335:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700793984:12345-0@lo:400:kworker.0 Request processed in 8479us (8810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075930.833354:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787075930.833379:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700793984:0@lo:400:kworker.0 00010000:00010000:1.0:1787075931.015777:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075931.426967:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075931.427030:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075931.427123:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678740736 00000100:00100000:0.0:1787075931.427133:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678740736 00000100:00100000:0.0:1787075931.427246:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 272 00000100:00100000:0.0:1787075931.427256:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2361:x1873884678740736:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075931.427368:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678740864 00000100:00100000:2.0:1787075931.427373:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678740864 00000100:00080000:1.0:1787075931.427430:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787075931.427431:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 104 00000100:00100000:2.0:1787075931.427439:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678740864:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075931.427499:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678740864:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 60us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075931.427499:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2361:x1873884678740736:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 245us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075931.427507:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 104 00000100:00100000:0.0:1787075931.427507:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 272 00000100:00100000:2.0:1787075931.429919:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075931.429970:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075931.430193:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678741120 00000100:00100000:3.0:1787075931.430204:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678741120 00000100:00100000:3.0:1787075931.430301:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 105 00000100:00100000:3.0:1787075931.430313:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2362:x1873884678741120:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075931.430397:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2362:x1873884678741120:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 86us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075931.430405:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 105 00000100:00080000:2.0:1787075931.430993:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075931.431994:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678740992 00000100:00100000:1.0:1787075931.432005:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678740992 00000100:00100000:1.0:1787075931.432080:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:1.0:1787075931.432089:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2361:x1873884678740992:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075931.432147:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2361:x1873884678740992:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 59us (2253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075931.432154:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00080000:2.0:1787075931.432439:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787075931.848030:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787075931.848056:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700794240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787075931.848130:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075931.848252:0:9220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700794240 00000100:00100000:3.0:1787075931.848261:0:9220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700794240 00000100:00100000:3.0:1787075931.848320:0:9220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787075931.848330:0:9220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700794240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787075931.848369:0:9220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787075931.848418:0:9220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700794240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075931.848424:0:9220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1787075931.848494:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996191941f80 x1873884700794240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075931.848523:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700794240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787075932.042347:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075933.066497:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075934.087949:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075935.119564:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075935.944873:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700794368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075935.944979:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075935.945454:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700794368 00000100:00100000:3.0:1787075935.945523:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700794368 00000100:00100000:3.0:1787075935.945636:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787075935.945966:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700794368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787075935.946048:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787075935.946148:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700794368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 187us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075935.946156:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787075935.946268:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700794368:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787075935.947274:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787075935.950633:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700794624:0@lo:400:kworker.0 00000100:00100000:3.0:1787075935.950740:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075935.950798:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787075935.950804:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700794752:0@lo:400:kworker.0 00000100:00100000:3.0:1787075935.950829:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075935.950873:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700794624 00000100:00100000:3.0:1787075935.950883:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700794624 00000100:00100000:3.0:1787075935.950937:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700794752 00000100:00100000:3.0:1787075935.950941:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700794752 00000100:00100000:3.0:1787075935.950978:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787075935.950989:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700794624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075935.951054:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700794624:12345-0@lo:400:kworker.0 Request processed in 67us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075935.951062:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787075935.951081:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787075935.951087:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700794752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075935.951116:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700794752:12345-0@lo:400:kworker.0 Request processed in 31us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075935.951123:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787075935.951180:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700794752:0@lo:400:kworker.0 00000100:00100000:3.0:1787075935.951193:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700794624:0@lo:400:kworker.0 00000100:00080000:3.0:1787075935.951240:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075935.951254:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700794880:0@lo:400:kworker.0 00000100:00100000:3.0:1787075935.951290:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075935.951312:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787075935.951319:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700794496:0@lo:400:kworker.0 00000100:00100000:3.0:1787075935.951353:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075935.952315:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873884700795008:0@lo:400:kworker.0 00000100:00100000:3.0:1787075935.952356:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075935.952593:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700794880 00000100:00100000:3.0:1787075935.952610:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700794880 00000100:00100000:3.0:1787075935.952676:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787075935.952686:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700794880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075935.952736:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700794880:12345-0@lo:400:kworker.0 Request processed in 52us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075935.952745:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1787075935.952771:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787075935.952782:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700795008 00000100:00100000:3.0:1787075935.952785:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700795008 00000100:00100000:3.0:1787075935.952815:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787075935.952822:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873884700795008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075935.952853:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873884700795008:12345-0@lo:400:kworker.0 Request processed in 32us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075935.952861:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1787075935.952879:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075935.952911:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873884700795008:0@lo:400:kworker.0 00010000:00080000:3.0:1787075935.952927:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961bf3a4000 x1873884700794880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075935.952947:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700794880:0@lo:400:kworker.0 00000100:00100000:1.0:1787075935.953779:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700794496 00000100:00100000:1.0:1787075935.953790:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700794496 00000100:00100000:1.0:1787075935.953845:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787075935.953855:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3311:x1873884700794496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075935.953922:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3311:x1873884700794496:12345-0@lo:400:kworker.0 Request processed in 69us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075935.953929:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787075935.955901:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700794496:0@lo:400:kworker.0 00010000:00010000:0.0:1787075936.138619:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075936.541829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075936.541882:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075936.541927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075936.547196:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678741376 00000100:00100000:3.0:1787075936.547214:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678741376 00000100:00100000:3.0:1787075936.547305:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 109 00000100:00100000:3.0:1787075936.547319:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678741376:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075936.547415:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678741376:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 100us (5599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075936.547424:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 109 00000100:00080000:3.0:1787075936.547447:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075936.547501:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075936.547782:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678741632 00000100:00100000:3.0:1787075936.547787:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678741632 00000100:00100000:3.0:1787075936.547821:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 110 00000100:00100000:3.0:1787075936.547829:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2362:x1873884678741632:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075936.547863:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2362:x1873884678741632:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 35us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075936.547868:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 110 00000100:00080000:3.0:1787075936.547884:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787075936.548004:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678741248 00000100:00100000:0.0:1787075936.548010:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678741248 00000100:00100000:0.0:1787075936.548065:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 274 00000100:00100000:0.0:1787075936.548073:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2361:x1873884678741248:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075936.548107:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2361:x1873884678741248:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 36us (6225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075936.548114:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 274 00000100:00100000:1.0:1787075936.548431:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678741504 00000100:00100000:1.0:1787075936.548436:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678741504 00000100:00100000:1.0:1787075936.548489:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:1.0:1787075936.548499:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2361:x1873884678741504:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075936.548548:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2361:x1873884678741504:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 51us (6621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075936.548555:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00080000:0.0:1787075936.549292:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787075936.968333:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787075936.968382:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700795136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787075936.968466:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075936.969854:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700795136 00000100:00100000:2.0:1787075936.969867:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700795136 00000100:00100000:2.0:1787075936.969928:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787075936.969938:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700795136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787075936.969981:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075936.973633:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700795136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3685us (5155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075936.973665:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1787075936.983037:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996191941f80 x1873884700795136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787075936.983092:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700795136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787075937.160872:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075938.184105:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787075938.506021:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787075939.209281:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075940.233538:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787075941.064851:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700795648:0@lo:400:kworker.0 00000100:00100000:3.0:1787075941.064927:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075941.065012:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787075941.065019:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700795264:0@lo:400:kworker.0 00000100:00100000:3.0:1787075941.065047:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075941.065086:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700795776:0@lo:400:kworker.0 00000100:00100000:3.0:1787075941.065124:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075941.065157:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700795264 00000100:00100000:3.0:1787075941.065164:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700795264 00000100:00100000:3.0:1787075941.065205:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787075941.065215:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700795264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075941.065454:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700795264:12345-0@lo:400:kworker.0 Request processed in 239us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075941.065462:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787075941.065511:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700795776 00000100:00100000:3.0:1787075941.065515:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700795776 00000100:00100000:3.0:1787075941.065549:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787075941.065555:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700795776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075941.065814:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700795776:12345-0@lo:400:kworker.0 Request processed in 258us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075941.065821:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787075941.065857:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700795264:0@lo:400:kworker.0 00000100:00100000:3.0:1787075941.065875:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700795776:0@lo:400:kworker.0 00000100:00100000:0.0:1787075941.066008:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700795392:0@lo:400:kworker.0 00000100:00100000:0.0:1787075941.066046:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075941.066068:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700795904:0@lo:400:kworker.0 00000100:00100000:0.0:1787075941.066092:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075941.066221:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787075941.066230:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700795520:0@lo:400:kworker.0 00000100:00100000:0.0:1787075941.066253:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075941.066422:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700795392 00000100:00100000:0.0:1787075941.066427:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700795392 00000100:00100000:0.0:1787075941.066457:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700795520 00000100:00100000:0.0:1787075941.066460:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700795520 00000100:00100000:0.0:1787075941.066481:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787075941.066488:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700795392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075941.066538:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700795392:12345-0@lo:400:kworker.0 Request processed in 51us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075941.066545:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787075941.066558:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787075941.066693:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700795648 00000100:00100000:1.0:1787075941.066699:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700795648 00000100:00100000:1.0:1787075941.066730:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700795904 00000100:00100000:1.0:1787075941.066734:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700795904 00000100:00100000:1.0:1787075941.066753:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787075941.066760:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700795648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075941.066804:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700795648:12345-0@lo:400:kworker.0 Request processed in 44us (1876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075941.066810:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787075941.066820:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787075941.066826:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700795904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075941.066852:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700795904:12345-0@lo:400:kworker.0 Request processed in 27us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075941.066857:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1787075941.066894:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996184e67480 x1873884700795648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075941.066918:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700795648:0@lo:400:kworker.0 00000100:00100000:3.0:1787075941.067762:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700795392:0@lo:400:kworker.0 00000100:00100000:3.0:1787075941.067774:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700795904:0@lo:400:kworker.0 00000100:00100000:3.0:1787075941.067785:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787075941.067796:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700796032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787075941.067838:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075941.067875:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700796032 00000100:00100000:3.0:1787075941.067880:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700796032 00000100:00100000:3.0:1787075941.067922:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787075941.067929:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700796032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787075941.067960:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787075941.068012:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700796032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075941.068019:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787075941.068045:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700796032:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787075941.068089:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787075941.068094:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787075941.068097:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787075941.068261:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700795520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075941.068318:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700795520:12345-0@lo:400:kworker.0 Request processed in 1036us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075941.068435:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700795520:0@lo:400:kworker.0 00000100:00100000:0.0:1787075941.074452:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00010000:1.0:1787075941.258048:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075941.670466:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075941.670525:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075941.670750:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678741760 00000100:00100000:3.0:1787075941.670760:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678741760 00000100:00100000:3.0:1787075941.670821:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 276 00000100:00100000:3.0:1787075941.670832:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2361:x1873884678741760:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075941.670904:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2361:x1873884678741760:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 75us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075941.670911:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 276 00000100:00100000:2.0:1787075941.671217:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678741888 00000100:00100000:2.0:1787075941.671222:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678741888 00000100:00100000:2.0:1787075941.671273:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:2.0:1787075941.671281:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2361:x1873884678741888:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075941.671331:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2361:x1873884678741888:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 51us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075941.671338:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00080000:0.0:1787075941.671474:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787075941.690754:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075941.690806:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075941.690969:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678742016 00000100:00100000:1.0:1787075941.690979:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678742016 00000100:00100000:1.0:1787075941.691056:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:1.0:1787075941.691067:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2358:x1873884678742016:12345-192.168.204.50@tcp:9:kworker.0 00000020:00000080:1.0:1787075941.691116:0:6704:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f68c 00000100:00080000:1.0:1787075941.691125:0:6704:0:(import.c:65:import_set_state_nolock()) ffff9961b521e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787075941.691164:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1787075941.691559:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075941.691835:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+2:2358:x1873884678742016:12345-192.168.204.50@tcp:9:kworker.0 Request processed in 767us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075941.691844:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:2.0:1787075941.692062:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678742144 00000100:00100000:2.0:1787075941.692069:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678742144 00000100:00100000:2.0:1787075941.692130:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00100000:2.0:1787075941.692140:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2360:x1873884678742144:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075941.692188:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2360:x1873884678742144:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 50us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075941.692196:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00080000:0.0:1787075941.692842:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787075941.692848:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787075942.090394:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787075942.090423:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700796160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787075942.090515:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075942.090779:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700796160 00000100:00100000:0.0:1787075942.090789:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700796160 00000100:00100000:0.0:1787075942.090846:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787075942.090856:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700796160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787075942.090894:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787075942.090948:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700796160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075942.090956:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787075942.092375:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996191941880 x1873884700796160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787075942.092411:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700796160:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787075942.279946:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787075943.303837:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075944.328018:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787075945.259235:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a850c61f-0242-4b36-8952-7b46dff1f2b9 00000020:00000080:3.0:1787075945.259245:0:7657:0:(genops.c:906:class_export_put()) final put ffff9961b521d000/a850c61f-0242-4b36-8952-7b46dff1f2b9 00000020:00000080:0.0:1787075945.259377:0:484:0:(genops.c:865:class_export_destroy()) destroying export ffff9961b521d000/a850c61f-0242-4b36-8952-7b46dff1f2b9 for lustre-OST0001 00000020:00000080:0.0:1787075945.259449:0:484:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961b521e800 for lustre-OST0001 00010000:00010000:3.0:1787075945.352798:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075946.184934:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700796672:0@lo:400:kworker.0 00000100:00100000:0.0:1787075946.185048:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075946.185129:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787075946.185137:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700796288:0@lo:400:kworker.0 00000100:00100000:0.0:1787075946.185175:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075946.185205:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700796800:0@lo:400:kworker.0 00000100:00100000:0.0:1787075946.185263:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075946.185304:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700796416:0@lo:400:kworker.0 00000100:00100000:0.0:1787075946.185340:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075946.185362:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700796928:0@lo:400:kworker.0 00000100:00100000:0.0:1787075946.185388:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075946.185423:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787075946.185439:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700796544:0@lo:400:kworker.0 00000100:00100000:0.0:1787075946.185460:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075946.186092:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700796288 00000100:00100000:3.0:1787075946.186108:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700796288 00000100:00100000:3.0:1787075946.186174:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787075946.186186:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700796288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075946.186281:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700796288:12345-0@lo:400:kworker.0 Request processed in 97us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075946.186289:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787075946.186381:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787075946.186390:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700797056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787075946.186431:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075946.186465:0:9220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700797056 00000100:00100000:3.0:1787075946.186469:0:9220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700797056 00000100:00100000:3.0:1787075946.188103:0:9220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787075946.188125:0:9220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700797056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787075946.188182:0:9220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787075946.188292:0:9220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700797056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 175us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075946.188300:0:9220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1787075946.188332:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787075946.188430:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700797056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787075946.189091:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700796800 00000100:00100000:2.0:1787075946.189103:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700796800 00000100:00100000:2.0:1787075946.189170:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700796416 00000100:00100000:2.0:1787075946.189174:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700796416 00000100:00100000:2.0:1787075946.189188:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700796544 00000100:00100000:2.0:1787075946.189192:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700796544 00000100:00100000:2.0:1787075946.189209:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787075946.189218:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700796800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075946.190181:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700796800:12345-0@lo:400:kworker.0 Request processed in 957us (4909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075946.190196:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787075946.190226:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787075946.190235:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700796416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075946.190936:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700796672 00000100:00100000:1.0:1787075946.191006:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700796672 00000100:00100000:1.0:1787075946.191063:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700796928 00000100:00100000:1.0:1787075946.191067:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700796928 00000100:00100000:1.0:1787075946.191095:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787075946.191103:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700796672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075946.191152:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700796672:12345-0@lo:400:kworker.0 Request processed in 50us (6106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075946.191157:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700796416:12345-0@lo:400:kworker.0 Request processed in 923us (5816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075946.191160:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787075946.191163:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787075946.191175:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787075946.191176:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787075946.191181:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700796928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075946.191183:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700796544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075946.191208:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700796544:12345-0@lo:400:kworker.0 Request processed in 26us (5747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075946.191215:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787075946.191372:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700796928:12345-0@lo:400:kworker.0 Request processed in 28us (5819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075946.191386:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787075946.191492:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700796288:0@lo:400:kworker.0 00000100:00100000:1.0:1787075946.191515:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700796800:0@lo:400:kworker.0 00010000:00080000:1.0:1787075946.191536:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961bf754700 x1873884700796672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787075946.191548:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700796672:0@lo:400:kworker.0 00000100:00080000:1.0:1787075946.191606:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787075946.191614:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075946.191665:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700796544:0@lo:400:kworker.0 00000100:00100000:1.0:1787075946.191680:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700796416:0@lo:400:kworker.0 00000100:00100000:1.0:1787075946.191691:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700796928:0@lo:400:kworker.0 00010000:00010000:0.0:1787075946.381165:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075946.785540:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075946.785605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075946.785632:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678742400 00000100:00100000:2.0:1787075946.785671:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678742400 00000100:00100000:0.0:1787075946.785688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075946.785778:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678742528 00000100:00100000:2.0:1787075946.785782:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678742528 00000100:00100000:1.0:1787075946.785923:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678742272 00000100:00100000:1.0:1787075946.785929:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678742272 00000100:00100000:1.0:1787075946.785974:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 278 00000100:00100000:1.0:1787075946.785986:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961911b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2361:x1873884678742272:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075946.786117:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961911b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2361:x1873884678742272:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 133us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075946.786127:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 278 00000100:00080000:1.0:1787075946.786177:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787075946.786214:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 119 00000100:00100000:2.0:1787075946.786225:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678742400:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075946.786268:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678742400:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 46us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075946.786321:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 120 00000100:00100000:0.0:1787075946.786336:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2361:x1873884678742528:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075946.786371:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2361:x1873884678742528:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 41us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075946.786379:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 120 00000100:00100000:2.0:1787075946.798984:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 119 00000100:00100000:0.0:1787075947.209026:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787075947.209060:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700797184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787075947.209159:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075947.209191:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700797184 00000100:00100000:3.0:1787075947.209203:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700797184 00000100:00100000:3.0:1787075947.209268:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787075947.209280:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700797184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787075947.209327:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787075947.209399:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700797184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075947.209407:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1787075947.211197:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961c1e38700 x1873884700797184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075947.211229:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700797184:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787075947.401532:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075948.424707:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787075948.744415:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787075949.448352:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787075950.349595:0:11858:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 13:59:08 (1787075948) 00010000:00010000:2.0:1787075950.481278:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075951.304229:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700797696:0@lo:400:kworker.0 00000100:00100000:1.0:1787075951.304320:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075951.304419:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787075951.304427:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700797312:0@lo:400:kworker.0 00000100:00100000:1.0:1787075951.304470:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075951.304510:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700797824:0@lo:400:kworker.0 00000100:00100000:1.0:1787075951.304537:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075951.304567:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700797312 00000100:00100000:1.0:1787075951.304575:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700797312 00000100:00100000:1.0:1787075951.304627:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787075951.304637:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700797312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075951.304717:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700797312:12345-0@lo:400:kworker.0 Request processed in 82us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075951.304724:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787075951.304773:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700797312:0@lo:400:kworker.0 00000100:00100000:0.0:1787075951.305035:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700797568:0@lo:400:kworker.0 00000100:00100000:0.0:1787075951.305076:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075951.305106:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787075951.305112:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700797440:0@lo:400:kworker.0 00000100:00100000:0.0:1787075951.305135:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075951.305151:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700797952:0@lo:400:kworker.0 00000100:00100000:0.0:1787075951.305173:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075951.305197:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700797824 00000100:00100000:0.0:1787075951.305200:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700797824 00000100:00100000:0.0:1787075951.305235:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700797568 00000100:00100000:0.0:1787075951.305238:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700797568 00000100:00100000:0.0:1787075951.305252:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700797440 00000100:00100000:0.0:1787075951.305254:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700797440 00000100:00100000:0.0:1787075951.305266:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787075951.305273:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700797824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075951.305318:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700797824:12345-0@lo:400:kworker.0 Request processed in 45us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075951.305325:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787075951.305339:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787075951.305345:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700797568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075951.305374:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700797568:12345-0@lo:400:kworker.0 Request processed in 30us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075951.305380:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787075951.305391:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787075951.305397:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700797440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075951.305422:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700797440:12345-0@lo:400:kworker.0 Request processed in 26us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075951.305439:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1787075951.305454:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787075951.305475:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700797440:0@lo:400:kworker.0 00000100:00100000:1.0:1787075951.305631:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700797696 00000100:00100000:1.0:1787075951.305636:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700797696 00000100:00100000:1.0:1787075951.305691:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700797952 00000100:00100000:1.0:1787075951.305695:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700797952 00000100:00100000:1.0:1787075951.305714:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787075951.305720:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700797696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075951.305824:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787075951.305834:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700797952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075951.305900:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700797568:0@lo:400:kworker.0 00000100:00080000:0.0:1787075951.305918:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787075951.305921:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787075951.306122:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700798080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075951.306175:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700797696:12345-0@lo:400:kworker.0 Request processed in 455us (1855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075951.306181:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787075951.306948:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700797952:12345-0@lo:400:kworker.0 Request processed in 1113us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075951.306956:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787075951.307263:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700797824:0@lo:400:kworker.0 00010000:00080000:0.0:1787075951.307280:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961bfc35880 x1873884700797696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787075967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787075951.307291:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700797696:0@lo:400:kworker.0 00000100:00100000:2.0:1787075951.307376:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075951.307678:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700797952:0@lo:400:kworker.0 00000100:00100000:3.0:1787075951.307750:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700798080 00000100:00100000:3.0:1787075951.307756:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700798080 00000100:00100000:3.0:1787075951.307845:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787075951.307853:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700798080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787075951.307886:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787075951.307934:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700798080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075951.307940:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787075951.308001:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700798080:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787075951.497224:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075951.917204:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075951.917258:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075951.917308:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075951.917448:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678742912 00000100:00100000:3.0:1787075951.917467:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678742912 00000100:00100000:3.0:1787075951.917577:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678742784 00000100:00100000:3.0:1787075951.917582:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678742784 00000100:00100000:3.0:1787075951.917616:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 124 00000100:00100000:3.0:1787075951.917630:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2359:x1873884678742912:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075951.917778:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2359:x1873884678742912:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 150us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075951.917787:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 124 00000100:00100000:3.0:1787075951.917811:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 125 00000100:00100000:3.0:1787075951.917818:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2359:x1873884678742784:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075951.917849:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2359:x1873884678742784:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 32us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075951.917856:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 125 00000100:00100000:0.0:1787075951.918317:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678742656 00000100:00100000:0.0:1787075951.918325:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678742656 00000100:00100000:0.0:1787075951.918372:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 280 00000100:00100000:0.0:1787075951.918381:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2359:x1873884678742656:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075951.918442:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2359:x1873884678742656:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 62us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075951.918450:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 280 00000100:00080000:1.0:1787075951.919235:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075952.139999:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075952.140198:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678743040 00000100:00100000:3.0:1787075952.140217:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678743040 00000100:00100000:3.0:1787075952.140313:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:3.0:1787075952.140326:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:10222:x1873884678743040:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787075952.140355:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075952.140387:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869f757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623402 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.140494:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad6869f75e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.140512:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad6869f75e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.140530:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad6869f75e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075952.141389:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787075952.141398:0:5854:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787075952.141672:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad6869f75e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.141716:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869f757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623402 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.141742:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad6869f75e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623402 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.141752:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996194304800) 00010000:00010000:3.0:1787075952.141756:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787075952.141760:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522800, rc 0) 00000100:00100000:3.0:1787075952.142358:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:10222:x1873884678743040:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 2029us (2370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075952.142370:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:2.0:1787075952.154311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075952.161116:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678743168 00000100:00100000:3.0:1787075952.161144:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678743168 00000100:00100000:3.0:1787075952.161262:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:3.0:1787075952.161276:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:10223:x1873884678743168:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787075952.161317:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075952.161346:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869f765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623409 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.161443:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f76c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.161460:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f76c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.161473:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f76c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.161490:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f773 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.161498:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.161504:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.162472:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522000/0x859911ad6869f77a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.162498:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522000/0x859911ad6869f77a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.162510:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522000/0x859911ad6869f77a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075952.162621:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787075952.162627:0:5852:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787075952.163210:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996181522000/0x859911ad6869f77a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.163231:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f76c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.163239:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f76c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.163246:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f76c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.163254:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075952.163259:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f76c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.163267:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f76c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.163293:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996194304800) 00010000:00010000:3.0:1787075952.163297:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075952.163303:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f76c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.163322:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f76c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.163341:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.163347:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f773 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.163353:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f773 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.163358:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075952.163361:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f773 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.163367:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f773 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.163375:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff996194304000) 00010000:00010000:3.0:1787075952.163378:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075952.163381:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f773 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.163387:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f773 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.163481:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869f765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623409 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.163499:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522000/0x859911ad6869f77a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623409 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075952.163515:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff996194304300) 00010000:00010000:3.0:1787075952.163517:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787075952.163521:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522000, rc 0) 00000100:00100000:3.0:1787075952.163691:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:10223:x1873884678743168:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 2366us (9360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075952.163701:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:0.0:1787075952.187090:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075952.194551:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678743424 00000100:00100000:2.0:1787075952.194575:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678743424 00000100:00100000:2.0:1787075952.195270:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:2.0:1787075952.195296:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:10223:x1873884678743424:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787075952.195331:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075952.195363:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f781 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623410 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.196496:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f788 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.196522:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f788 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.196549:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f788 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.196570:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f78f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.196597:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f78f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.196605:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f78f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.197393:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033200/0x859911ad6869f796 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.197408:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033200/0x859911ad6869f796 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.197416:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033200/0x859911ad6869f796 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075952.197428:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787075952.197718:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f788 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.197727:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f788 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.197735:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f788 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.197742:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075952.197747:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f788 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.197754:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f788 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.197780:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff996194304300) 00010000:00010000:2.0:1787075952.197783:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075952.197789:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f788 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.197795:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f788 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.197811:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f78f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.197818:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f78f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.197823:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f78f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.197829:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075952.197832:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f78f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.197837:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f78f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.197846:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff996191b79900) 00010000:00010000:2.0:1787075952.197848:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075952.197851:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f78f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.197856:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f78f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.198462:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f781 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623410 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.198481:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033200/0x859911ad6869f796 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623410 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075952.198490:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996191b79600) 00010000:00010000:2.0:1787075952.198492:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075952.198495:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9033200, rc 0) 00000100:00100000:2.0:1787075952.198591:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:10223:x1873884678743424:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 3309us (12182us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787075952.198603:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:1.0:1787075952.224777:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075952.225577:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678743552 00000100:00100000:2.0:1787075952.225592:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678743552 00000100:00100000:2.0:1787075952.225718:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:2.0:1787075952.225730:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:10223:x1873884678743552:12345-192.168.204.50@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787075952.225872:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:10223:x1873884678743552:12345-192.168.204.50@tcp:59:lhsmtool_posix.0 Request processed in 144us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075952.225880:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:0.0:1787075952.328125:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700798208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787075952.328232:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075952.328454:0:9220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700798208 00000100:00100000:1.0:1787075952.328466:0:9220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700798208 00000100:00100000:1.0:1787075952.328538:0:9220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787075952.328550:0:9220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700798208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787075952.328604:0:9220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075952.328702:0:9220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700798208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075952.328711:0:9220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1787075952.328812:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9961bfc35500 x1873884700798208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787075968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787075952.328836:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700798208:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787075952.527005:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787075952.845078:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787075953.546749:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075954.571936:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075954.667069:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075954.667260:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678743680 00000100:00100000:3.0:1787075954.667277:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678743680 00000100:00100000:3.0:1787075954.667399:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:3.0:1787075954.667414:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:10266:x1873884678743680:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787075954.667447:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075954.667480:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869f7a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623417 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.667571:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.667590:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.667604:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.667676:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.667686:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.667693:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787075954.668106:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787075954.668218:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.668228:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7ab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.668246:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.668252:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075954.668257:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.668264:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.668279:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996194304800) 00010000:00010000:3.0:1787075954.668283:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075954.668288:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.668294:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.668315:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.668321:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.668327:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.668333:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075954.668336:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.668342:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.668351:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff996194304000) 00010000:00010000:3.0:1787075954.668353:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075954.668356:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.668363:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.668425:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869f7a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623417 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.668437:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996194304800) 00010000:00010000:3.0:1787075954.668439:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075954.668449:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869f7a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623417 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.668461:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522a00, rc 0) 00000100:00100000:3.0:1787075954.668557:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:10266:x1873884678743680:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1146us (1503us total) trans 0 rc 301/301 00000100:00100000:3.0:1787075954.668567:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:0.0:1787075954.678310:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075954.678438:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678743936 00000100:00100000:1.0:1787075954.678453:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678743936 00000100:00100000:1.0:1787075954.678528:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:1.0:1787075954.678540:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:10266:x1873884678743936:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:1.0:1787075954.678619:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075954.678691:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad6869f75e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623402 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075954.678716:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996194304800) 00010000:00010000:1.0:1787075954.678748:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787075954.679121:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869f7b9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075954.679139:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869f7b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075954.679150:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869f7b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075954.679178:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f7c0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075954.679187:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f7c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075954.679194:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f7c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075954.680463:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787075954.680480:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869f7b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075954.680490:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869f7b9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075954.680498:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869f7b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075954.680506:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075954.680511:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869f7b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075954.680520:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869f7b9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075954.680535:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996187c34000) 00010000:00010000:1.0:1787075954.680539:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075954.680543:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869f7b9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075954.680561:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869f7b9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787075954.680581:0:7654:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 000000003ea8820a reply state 00000000ac8021ef transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f7c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075954.680591:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787075954.680774:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+10:10266:x1873884678743936:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 2233us (2485us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787075954.680786:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 37 00010000:00010000:3.0:1787075954.689951:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f7c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.689973:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f7c0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.689982:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f7c0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.689989:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075954.689994:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f7c0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.690003:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f7c0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.690025:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff996187c34b00) 00010000:00010000:3.0:1787075954.690028:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075954.690034:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f7c0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.690041:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f7c0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075954.854685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075954.854900:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678744064 00000100:00100000:0.0:1787075954.854915:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678744064 00000100:00100000:0.0:1787075954.855005:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:0.0:1787075954.855020:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:10274:x1873884678744064:12345-192.168.204.50@tcp:101:lctl.0 00010000:00010000:0.0:1787075954.855063:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075954.855109:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869f7c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762341e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075954.855208:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69600/0x859911ad6869f7ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075954.855237:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69600/0x859911ad6869f7ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075954.855256:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69600/0x859911ad6869f7ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075954.855346:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787075954.855350:0:5854:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787075954.855405:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69600/0x859911ad6869f7ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075954.855444:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869f7c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762341e expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075954.855465:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69600/0x859911ad6869f7ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762341e expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075954.855496:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ab00) 00010000:00010000:0.0:1787075954.855500:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787075954.855505:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe69600, rc 0) 00000100:00100000:0.0:1787075954.855610:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+10:10274:x1873884678744064:12345-192.168.204.50@tcp:101:lctl.0 Request processed in 592us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075954.855619:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:0.0:1787075954.966586:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000001:00080000:0.0:1787075954.967304:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:3.0:1787075954.971588:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678744192 00000100:00100000:3.0:1787075954.971615:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678744192 00000100:00100000:3.0:1787075954.971747:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:3.0:1787075954.971762:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:10280:x1873884678744192:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787075954.971791:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075954.971820:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869f7d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623425 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.971926:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.971947:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.971961:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.971981:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.971989:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.971996:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.977944:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032e00/0x859911ad6869f7ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.977977:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032e00/0x859911ad6869f7ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.977995:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032e00/0x859911ad6869f7ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075954.978114:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787075954.978120:0:5852:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787075954.978243:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032e00/0x859911ad6869f7ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.978261:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.978268:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.978275:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.978282:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075954.978287:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.978295:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.978312:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ab00) 00010000:00010000:2.0:1787075954.978316:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075954.978321:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.978328:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869f7dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.978347:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.978364:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.981018:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.981031:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075954.981038:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.981051:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.981078:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff996194304000) 00010000:00010000:2.0:1787075954.981082:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075954.981090:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.981099:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869f7e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.981207:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869f7d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623425 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.981240:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032e00/0x859911ad6869f7ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623425 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075954.981249:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:2.0:1787075954.981251:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787075954.981282:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032e00, rc 0) 00000100:00100000:2.0:1787075954.981399:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:10280:x1873884678744192:12345-192.168.204.50@tcp:101:bash.0 Request processed in 9639us (14827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075954.981411:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:1.0:1787075954.990699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075954.990873:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678744448 00000100:00100000:3.0:1787075954.990889:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678744448 00000100:00100000:3.0:1787075954.990971:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:3.0:1787075954.990985:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:10280:x1873884678744448:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787075954.991040:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075954.991068:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f7f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762342c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.991529:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f7f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.991549:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f7f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.991563:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f7f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.991939:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f7ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.992210:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f7ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.992240:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f7ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787075954.994006:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787075954.994394:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f806 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.994412:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.994424:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.994470:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f7f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.994477:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f7f8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.994484:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f7f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.994490:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075954.994494:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f7f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.994966:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f7f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.994982:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:3.0:1787075954.994986:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075954.994991:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f7f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.994999:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f7f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787075954.995017:0:5853:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 000000009a557d1c reply state 00000000025f5e2c transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f7ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075954.995027:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787075954.995140:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f7f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762342c expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.995167:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762342c expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075954.995175:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304c00) 00010000:00010000:3.0:1787075954.995177:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787075954.995180:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523000, rc 0) 00000100:00100000:3.0:1787075954.995309:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+12:10280:x1873884678744448:12345-192.168.204.50@tcp:101:bash.0 Request processed in 4327us (4666us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787075954.995319:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 40 00010000:00010000:2.0:1787075955.001840:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f7ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.001865:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f7ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.001874:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f7ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.001882:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075955.001888:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f7ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.001897:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f7ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.001921:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996194304900) 00010000:00010000:2.0:1787075955.001925:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075955.001931:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f7ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.001938:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f7ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075955.002432:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075955.015759:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678744576 00000100:00100000:3.0:1787075955.015783:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678744576 00000100:00100000:3.0:1787075955.016220:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:3.0:1787075955.016248:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1873884678744576:12345-192.168.204.50@tcp:8:bash.0 00010000:00080000:3.0:1787075955.016295:0:6706:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:3.0:1787075955.016342:0:6706:0:(genops.c:1406:class_connect()) connect: client a850c61f-0242-4b36-8952-7b46dff1f2b9, cookie 0x859911ad6869f814 00002000:00100000:3.0:1787075955.016358:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a850c61f-0242-4b36-8952-7b46dff1f2b9/ffff9961a6e01000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787075955.016397:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787075955.018283:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787075955.018356:0:6706:0:(import.c:65:import_set_state_nolock()) ffff9961a6e02000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787075955.018482:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2358:x1873884678744576:12345-192.168.204.50@tcp:8:bash.0 Request processed in 2233us (16379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075955.018496:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:0.0:1787075955.029879:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075955.030891:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678744704 00000100:00100000:1.0:1787075955.030914:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678744704 00000100:00080000:0.0:1787075955.031194:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787075955.033656:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:1.0:1787075955.033694:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:0:x1873884678744704:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1787075955.033725:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075955.033761:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad6869f81b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623433 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787075955.033801:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787075955.033831:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=337s v=(0 0) 00010000:00010000:1.0:1787075955.033837:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787075955.033849:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad6869f81b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623433 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.033875:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad6869f81b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623433 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.033914:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf633c00, rc 0) 00000100:00100000:1.0:1787075955.034030:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:0:x1873884678744704:12345-192.168.204.50@tcp:101:bash.0 Request processed in 356us (4162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075955.034038:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:1.0:1787075955.043927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075955.044078:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678744832 00000100:00100000:2.0:1787075955.044097:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678744832 00000100:00100000:2.0:1787075955.044372:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:2.0:1787075955.044388:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:10280:x1873884678744832:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1787075955.044442:0:8477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075955.044475:0:8477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e835735/0x859911ad6869f822 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762343a expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.044524:0:8477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad6869f81b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623433 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.044537:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787075955.044544:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787075955.044552:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e835735/0x859911ad6869f822 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762343a expref: 8 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.044610:0:8477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad6869f81b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623433 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.044629:0:8477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad6869f81b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623433 expref: 8 pid: 6704 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075955.044690:0:8477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8477:1873884700798336:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787075955.044840:0:8477:0:(client.c:2702:ptlrpc_set_wait()) set ffff996189361cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787075955.053697:0:8477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8477:1873884700798336:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787075955.053752:0:8477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000e835735/0x859911ad6869f822 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762343a expref: 8 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.053787:0:8477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9033400, rc 0) 00000100:00100000:1.0:1787075955.053933:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:10280:x1873884678744832:12345-192.168.204.50@tcp:101:bash.0 Request processed in 9548us (10021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075955.053955:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:1.0:1787075955.058463:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075955.058563:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678744960 00000100:00100000:3.0:1787075955.058577:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678744960 00010000:00010000:3.0:1787075955.058693:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad6869f81b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623433 expref: 8 pid: 6704 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075955.058808:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:3.0:1787075955.058820:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf754700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2360:x1873884678744960:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787075955.058842:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075955.058875:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad6869f81b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623433 expref: 8 pid: 6704 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.058893:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad6869f81b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623433 expref: 8 pid: 6704 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.058932:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad6869f81b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623433 expref: 8 pid: 6704 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.058967:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787075955.058973:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787075955.058984:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e835735/0x859911ad6869f822 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762343a expref: 7 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.058996:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e835735/0x859911ad6869f822 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762343a expref: 7 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.059049:0:5838:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000e835735/0x859911ad6869f822 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762343a expref: 7 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075955.059080:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1882a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5838:1873884700798464:192.168.204.50@tcp:105: 00000100:00100000:3.0:1787075955.059701:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191860840 going to sleep for 11 seconds 00000100:00100000:3.0:1787075955.067000:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1882a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5838:1873884700798464:192.168.204.50@tcp:105: 00010000:00010000:3.0:1787075955.067051:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075955.067159:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf754700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2360:x1873884678744960:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 8340us (8709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075955.067297:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:1.0:1787075955.067526:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075955.067777:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678745216 00000100:00100000:0.0:1787075955.067786:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678745216 00000100:00100000:0.0:1787075955.067846:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:0.0:1787075955.067857:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+11:10280:x1873884678745216:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:0.0:1787075955.068690:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+12:10280:x1873884678745216:12345-192.168.204.50@tcp:35:bash.0 Request processed in 828us (1161us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787075955.068700:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:0.0:1787075955.182990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075955.183143:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678745472 00000100:00100000:1.0:1787075955.183159:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678745472 00000100:00100000:1.0:1787075955.183268:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:1.0:1787075955.183282:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+12:10290:x1873884678745472:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787075955.183327:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075955.183373:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869f829 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623441 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075955.183566:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787075955.183826:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869f829 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623441 expref: 14 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.183845:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ab00) 00010000:00010000:1.0:1787075955.183848:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787075955.183855:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869f829 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623441 expref: 14 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.183877:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632c00, rc 0) 00000100:00100000:1.0:1787075955.183969:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:10290:x1873884678745472:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 689us (997us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1787075955.183978:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:1.0:1787075955.190032:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075955.190816:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678745728 00000100:00100000:0.0:1787075955.190833:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678745728 00000100:00100000:0.0:1787075955.190921:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:0.0:1787075955.190934:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:10290:x1873884678745728:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1787075955.191912:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:10290:x1873884678745728:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 973us (1892us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787075955.191924:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:3.0:1787075955.258630:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075955.259296:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678745856 00000100:00100000:0.0:1787075955.259311:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678745856 00000100:00100000:0.0:1787075955.259411:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:0.0:1787075955.259424:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:10296:x1873884678745856:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787075955.259470:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075955.259509:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68c00/0x859911ad6869f837 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623448 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.259623:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869f83e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.259748:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869f83e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.259774:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869f83e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075955.260560:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787075955.260565:0:5854:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787075955.260601:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869f83e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.260684:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68c00/0x859911ad6869f837 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623448 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.260712:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869f83e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623448 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.260722:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:0.0:1787075955.260726:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787075955.262352:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe69c00, rc 0) 00000100:00100000:0.0:1787075955.262856:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+15:10296:x1873884678745856:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3421us (4231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075955.262870:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:1.0:1787075955.271813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075955.272755:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678746112 00000100:00100000:2.0:1787075955.272772:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678746112 00000100:00100000:2.0:1787075955.272868:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:2.0:1787075955.272881:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+15:10296:x1873884678746112:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787075955.272910:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075955.272942:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f845 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762344f expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.273305:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f84c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.273330:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f84c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.273346:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f84c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075955.273475:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787075955.273713:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f845 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762344f expref: 18 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.273743:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f84c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762344f expref: 17 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.273753:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304c00) 00010000:00010000:2.0:1787075955.273756:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787075955.273760:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032400, rc 0) 00000100:00100000:2.0:1787075955.273855:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+17:10296:x1873884678746112:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 976us (2060us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787075955.273865:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:1.0:1787075955.281092:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075955.281391:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075955.281556:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678746496 00000100:00100000:2.0:1787075955.281574:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678746496 00000100:00100000:2.0:1787075955.281701:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:2.0:1787075955.281715:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+17:2362:x1873884678746496:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075955.281737:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075955.281790:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f84c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762344f expref: 17 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.281816:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304c00) 00010000:00010000:2.0:1787075955.281823:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075955.281912:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+16:2362:x1873884678746496:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 199us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075955.281921:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:3.0:1787075955.286985:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678746368 00000100:00100000:3.0:1787075955.287082:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678746368 00000100:00100000:3.0:1787075955.287357:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:3.0:1787075955.287382:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+16:10296:x1873884678746368:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787075955.287537:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075955.287568:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f85a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623456 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.287749:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f861 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.287768:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f861 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.287783:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f861 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075955.287797:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787075955.288018:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f85a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623456 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.288041:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f861 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623456 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.288051:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304c00) 00010000:00010000:3.0:1787075955.288054:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787075955.288058:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522200, rc 0) 00000100:00100000:3.0:1787075955.288630:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+18:10296:x1873884678746368:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1250us (7550us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787075955.288662:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:1.0:1787075955.303610:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075955.303927:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678746624 00000100:00100000:3.0:1787075955.303941:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678746624 00000100:00100000:2.0:1787075955.304569:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:2.0:1787075955.304584:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2362:x1873884678746624:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:2.0:1787075955.304710:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c59d9c41/0x859911ad6869f86f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.304738:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e835735/0x859911ad6869f822 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762343a expref: 7 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.304749:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787075955.304754:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787075955.304760:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c59d9c41/0x859911ad6869f86f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.304807:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e835735/0x859911ad6869f822 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762343a expref: 7 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.304836:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e835735/0x859911ad6869f822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762343a expref: 7 pid: 8477 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075955.304885:0:6705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1873884700798592:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787075955.305033:0:6705:0:(client.c:2702:ptlrpc_set_wait()) set ffff996189361000 going to sleep for 11 seconds 00000100:00100000:3.0:1787075955.308749:0:6705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1873884700798592:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075955.308801:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c59d9c41/0x859911ad6869f86f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075955.309589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075955.310444:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678746752 00000100:00100000:3.0:1787075955.310457:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678746752 00002000:00100000:3.0:1787075955.310508:0:6709:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff996184e04380 x1873884678746752/t0(0) o4->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:26/0 lens 504/0 e 0 to 0 dl 1787075966 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787075955.310519:0:6709:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996184e04380 with x1873884678746752 ext(0->12) 00010000:00010000:3.0:1787075955.310528:0:6709:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000e835735/0x859911ad6869f822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762343a expref: 8 pid: 8477 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.310545:0:6709:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000e835735/0x859911ad6869f822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762343a expref: 8 pid: 8477 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787075955.310567:0:6709:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff996184e04380 00000100:00100000:3.0:1787075955.310706:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:3.0:1787075955.310718:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2362:x1873884678746752:12345-192.168.204.50@tcp:4:lfs.0 00000001:00100000:0.0:1787075955.373888:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a850c61f-0242-4b36-8952-7b46dff1f2b9 00000100:00100000:3.0:1787075955.375169:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:2362:x1873884678746752:12345-192.168.204.50@tcp:4:lfs.0 Request processed in 64444us (65583us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787075955.375184:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00002000:00100000:3.0:1787075955.375196:0:6709:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff996184e04380 x1873884678746752/t4294967299(0) o4->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:26/0 lens 504/448 e 0 to 0 dl 1787075966 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787075955.375206:0:6709:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996184e04380 with x1873884678746752 ext(0->12) 00010000:00010000:3.0:1787075955.375228:0:6709:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000e835735/0x859911ad6869f822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762343a expref: 9 pid: 8477 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.375248:0:6709:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000e835735/0x859911ad6869f822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762343a expref: 9 pid: 8477 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787075955.375256:0:6709:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff996184e04380 00000100:00100000:2.0:1787075955.378262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075955.378390:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678746880 00000100:00100000:1.0:1787075955.378403:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678746880 00010000:00010000:1.0:1787075955.378448:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e835735/0x859911ad6869f822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762343a expref: 9 pid: 8477 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075955.378495:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:1.0:1787075955.378506:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:2360:x1873884678746880:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787075955.378522:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787075955.378544:0:5837:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787075955.378561:0:5837:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787075955 00002000:00010000:1.0:1787075955.378563:0:5837:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787075955 00002000:00010000:1.0:1787075955.378566:0:5837:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787075955 00010000:00010000:1.0:1787075955.378573:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e835735/0x859911ad6869f822 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762343a expref: 9 pid: 8477 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.378587:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e835735/0x859911ad6869f822 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762343a expref: 9 pid: 8477 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.378610:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e835735/0x859911ad6869f822 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762343a expref: 9 pid: 8477 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.378633:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787075955.378693:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787075955.378701:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c59d9c41/0x859911ad6869f86f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.378711:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c59d9c41/0x859911ad6869f86f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.379025:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075955.379101:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2360:x1873884678746880:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 585us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075955.379111:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 36 00010000:00010000:0.0:1787075955.379555:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c59d9c41/0x859911ad6869f86f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.379567:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c59d9c41/0x859911ad6869f86f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.379598:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c59d9c41/0x859911ad6869f86f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.379607:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c59d9c41/0x859911ad6869f86f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.379615:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c59d9c41/0x859911ad6869f86f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.379623:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032400 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787075955.379628:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c59d9c41/0x859911ad6869f86f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.379666:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c59d9c41/0x859911ad6869f86f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.379703:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c59d9c41/0x859911ad6869f86f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.379710:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c59d9c41/0x859911ad6869f86f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075955.379788:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2362:x1873884678746624:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 75207us (76191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075955.379797:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:2.0:1787075955.391423:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075955.391546:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678747136 00000100:00100000:0.0:1787075955.391556:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678747136 00000100:00100000:0.0:1787075955.391619:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:0.0:1787075955.391631:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+18:10296:x1873884678747136:12345-192.168.204.50@tcp:35:lfs.0 00000004:00010000:0.0:1787075955.391759:0:5856:0:(mdt_open.c:1970:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f861 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623456 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787075955.392086:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1787075955.392153:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787075955.392897:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787075955.392967:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869f876 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.392986:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f806 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762342c expref: 22 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.392995:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869f876 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.393063:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762342c expref: 22 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.393080:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f806 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762342c expref: 22 pid: 5853 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075955.393095:0:5856:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94baa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5856:1873884700798720:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787075955.393197:0:5856:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616000 going to sleep for 11 seconds 00000100:00100000:0.0:1787075955.396610:0:5856:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94baa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5856:1873884700798720:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787075955.396683:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869f876 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075955.397868:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075955.398092:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678747264 00000100:00100000:3.0:1787075955.398112:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678747264 00010000:00010000:3.0:1787075955.398170:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f806 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762342c expref: 23 pid: 5853 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075955.398234:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:3.0:1787075955.398250:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+23:2362:x1873884678747264:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787075955.398308:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075955.398318:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f806 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762342c expref: 23 pid: 5853 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.398334:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762342c expref: 23 pid: 5853 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.398374:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f806 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762342c expref: 23 pid: 5853 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.398398:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304c00) 00010000:00010000:3.0:1787075955.398404:0:8465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869f876 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.398417:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869f876 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.398425:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869f876 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.398461:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075955.398537:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+22:2362:x1873884678747264:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 292us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075955.398547:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 37 00010000:00010000:0.0:1787075955.399902:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869f876 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.399924:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869f876 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787075955.400724:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787075955.400993:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1787075955.401157:0:5856:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94baa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1873884700798848:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787075955.401243:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075955.401288:0:5856:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf6160c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787075955.401522:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700798848 00000100:00100000:1.0:1787075955.401530:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700798848 00000100:00100000:1.0:1787075955.401613:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787075955.401623:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1873884700798848:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787075955.401751:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1873884700798848:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 130us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075955.401759:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787075955.401803:0:5856:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94baa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1873884700798848:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787075955.402476:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1787075955.402550:0:5856:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e07480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1873884700798976:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787075955.402602:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075955.402697:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700798976 00000100:00100000:1.0:1787075955.402705:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700798976 00000100:00100000:1.0:1787075955.402747:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787075955.402757:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1873884700798976:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787075955.402936:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5856:x1873884700798976:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 179us (332us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787075955.402944:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787075955.402973:0:5856:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618b8e1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787075955.402998:0:5856:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e07480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1873884700798976:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787075955.403039:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1787075955.403073:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869f876 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.403082:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869f876 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.403089:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869f876 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.403095:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075955.403107:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869f876 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.403114:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869f876 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.403129:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304c00) 00010000:00010000:1.0:1787075955.403132:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787075955.403136:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869f876 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.403143:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869f876 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787075955.403321:0:5856:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787075955.403527:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787075955.403541:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337378900656ns, next at 338378898496ns, rc = 0 00000001:00080000:1.0:1787075955.403548:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1787075955.403579:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304c00) 00010000:00010000:1.0:1787075955.403583:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787075955.403591:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f861 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623456 expref: 26 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075955.403747:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+25:10296:x1873884678747136:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 12118us (12336us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787075955.403762:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00000020:00080000:1.0:1787075955.403766:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1787075955.403956:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787075955.409526:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075955.410000:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678747392 00000100:00100000:1.0:1787075955.410010:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678747392 00000100:00100000:1.0:1787075955.410102:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:1.0:1787075955.410114:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+25:10296:x1873884678747392:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787075955.410157:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075955.410180:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869f87d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762345d expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.410256:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869f87d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762345d expref: 26 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.410272:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869f87d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762345d expref: 26 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075955.410293:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:1.0:1787075955.410297:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787075955.410300:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632600, rc 0) 00000100:00100000:1.0:1787075955.410380:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+26:10296:x1873884678747392:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 268us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075955.410387:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:2.0:1787075955.428540:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075955.429319:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678747648 00000100:00100000:0.0:1787075955.429337:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678747648 00000100:00100000:0.0:1787075955.429451:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:0.0:1787075955.429463:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b0117c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+26:10296:x1873884678747648:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1787075955.430914:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b0117c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+27:10296:x1873884678747648:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 1435us (2370us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1787075955.430936:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:2.0:1787075955.529499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075955.529600:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678747904 00000100:00100000:0.0:1787075955.529617:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678747904 00000100:00100000:0.0:1787075955.529720:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:0.0:1787075955.529731:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+27:10306:x1873884678747904:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787075955.529765:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075955.529794:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad6869f884 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623464 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075955.529950:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787075955.530069:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad6869f884 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623464 expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.530085:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ab00) 00010000:00010000:0.0:1787075955.530088:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787075955.530092:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad6869f884 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623464 expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.530108:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe68600, rc 0) 00000100:00100000:0.0:1787075955.530188:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+28:10306:x1873884678747904:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 458us (696us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1787075955.530195:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:2.0:1787075955.535060:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075955.535388:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678748032 00000100:00100000:3.0:1787075955.535401:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678748032 00000100:00100000:3.0:1787075955.535475:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:3.0:1787075955.535486:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+28:10306:x1873884678748032:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:3.0:1787075955.535600:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f892 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.535621:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f892 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.535633:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f892 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.535686:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f899 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.535693:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.535700:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.535809:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.535817:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.535825:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787075955.535869:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.535882:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f892 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.535915:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f892 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.535921:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f892 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.535928:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075955.535933:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f892 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.535941:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f892 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.535954:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:3.0:1787075955.535957:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075955.535962:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f892 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.535967:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869f892 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.535986:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.535992:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f899 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.535997:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f899 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.536002:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075955.536011:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f899 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.536018:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f899 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.536026:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996194304000) 00010000:00010000:3.0:1787075955.536029:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075955.536032:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f899 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.536038:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f899 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.536067:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.536073:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.536078:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.536083:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075955.536086:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.536092:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.536100:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:3.0:1787075955.536102:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075955.536112:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.536118:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075955.536699:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+28:10306:x1873884678748032:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 1210us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075955.536710:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:1.0:1787075955.544018:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075955.545703:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678748288 00000100:00100000:0.0:1787075955.545763:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678748288 00000100:00100000:0.0:1787075955.545902:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:0.0:1787075955.545929:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+28:10306:x1873884678748288:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1787075955.546223:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+29:10306:x1873884678748288:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 287us (2205us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1787075955.546232:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:2.0:1787075955.590898:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1787075955.591876:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075955.592405:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678748544 00000100:00100000:0.0:1787075955.592417:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678748544 00000100:00100000:2.0:1787075955.592677:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:2.0:1787075955.592689:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+29:10309:x1873884678748544:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787075955.592716:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075955.592738:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f8a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762346b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.592842:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f8ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.592861:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f8ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.592876:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f8ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.592896:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f8b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.592939:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.592947:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593109:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f8bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593119:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f8bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593126:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f8bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075955.593136:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787075955.593273:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f8ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593282:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f8ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593290:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f8ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593298:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075955.593303:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f8ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593312:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f8ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593354:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:2.0:1787075955.593358:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075955.593364:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f8ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593370:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f8ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593390:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593397:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593403:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593410:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9033400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075955.593413:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593420:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f8b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593428:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996191b79700) 00010000:00010000:2.0:1787075955.593431:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075955.593434:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f8b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593439:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f8b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593505:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f8a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762346b expref: 32 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593520:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f8bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762346b expref: 31 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.593528:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:2.0:1787075955.593531:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787075955.593534:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032600, rc 0) 00000100:00100000:2.0:1787075955.595002:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+31:10309:x1873884678748544:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2302us (4107us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787075955.595027:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:3.0:1787075955.599224:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075955.599302:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678748672 00000100:00100000:0.0:1787075955.599317:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678748672 00000100:00100000:0.0:1787075955.599392:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:0.0:1787075955.599403:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+31:10309:x1873884678748672:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:0.0:1787075955.599484:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad6869f8ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.599504:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad6869f8ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.599516:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad6869f8ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.599604:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad6869f8ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.599613:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad6869f8ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.599619:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad6869f8ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.599626:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075955.599630:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad6869f8ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.599677:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad6869f8ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.599689:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:0.0:1787075955.599692:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787075955.599698:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad6869f8ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.599704:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad6869f8ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075955.599774:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+31:10309:x1873884678748672:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 372us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075955.599781:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:1.0:1787075955.603371:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075955.604582:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678748928 00000100:00100000:2.0:1787075955.604596:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678748928 00000100:00100000:2.0:1787075955.604693:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:2.0:1787075955.604703:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+31:10309:x1873884678748928:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1787075955.605452:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+32:10309:x1873884678748928:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 748us (2094us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787075955.605462:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:2.0:1787075955.881988:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075955.882304:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678749184 00000100:00100000:3.0:1787075955.882530:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678749184 00000100:00100000:3.0:1787075955.882620:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:3.0:1787075955.882632:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+32:10340:x1873884678749184:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1787075955.882761:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075955.882786:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623472 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.882891:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f8d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.882905:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.882916:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075955.882928:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787075955.883083:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623472 expref: 35 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.883126:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623472 expref: 34 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075955.883137:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:3.0:1787075955.883140:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787075955.883144:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523400, rc 0) 00000100:00100000:3.0:1787075955.883228:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+34:10340:x1873884678749184:12345-192.168.204.50@tcp:101:cat.0 Request processed in 598us (1255us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787075955.883236:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:3.0:1787075955.890118:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075955.890293:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075955.890427:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678749568 00000100:00100000:0.0:1787075955.890437:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678749568 00000100:00100000:2.0:1787075955.890447:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678749312 00000100:00100000:2.0:1787075955.890451:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678749312 00000100:00100000:0.0:1787075955.890561:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:0.0:1787075955.890572:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+35:10340:x1873884678749568:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:0.0:1787075955.891168:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+36:10340:x1873884678749568:12345-192.168.204.50@tcp:35:cat.0 Request processed in 595us (871us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787075955.891178:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:2.0:1787075955.891399:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:2.0:1787075955.891412:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a03cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+35:2361:x1873884678749312:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075955.891427:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075955.891478:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869f8d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623472 expref: 35 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075955.891502:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:2.0:1787075955.891508:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075955.891532:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a03cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+34:2361:x1873884678749312:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 125us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075955.891539:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:1.0:1787075955.980335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075955.982026:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678749824 00000100:00100000:0.0:1787075955.982049:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678749824 00000100:00100000:0.0:1787075955.982144:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:0.0:1787075955.982157:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+34:10346:x1873884678749824:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:0.0:1787075955.982184:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075955.982188:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787075955.982253:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869f83e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623448 expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.982279:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:0.0:1787075955.982285:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787075955.982302:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad6869f8e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623479 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.982428:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869f8ed lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.982444:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f8bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762346b expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.982453:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869f8ed lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.982491:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f8bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762346b expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075955.982507:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f8bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762346b expref: 34 pid: 5854 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075955.982525:0:5852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1873884700799104:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787075955.982706:0:5852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787075955.998560:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075956.001626:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678749952 00000100:00100000:3.0:1787075956.001698:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678749952 00010000:00010000:3.0:1787075956.001814:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f8bc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762346b expref: 35 pid: 5854 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075956.001863:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:3.0:1787075956.001874:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+35:2362:x1873884678749952:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787075956.001891:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075956.001898:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f8bc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762346b expref: 35 pid: 5854 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075956.001913:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f8bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762346b expref: 35 pid: 5854 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075956.001938:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:3.0:1787075956.001959:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869f8ed lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075956.001970:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869f8ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075956.001977:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869f8ed lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075956.002000:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1787075956.002027:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075956.002091:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+35:2362:x1873884678749952:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 217us (3540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075956.002100:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00010000:00010000:0.0:1787075956.003878:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f8bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762346b expref: 34 pid: 5854 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075956.003907:0:5852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1873884700799104:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787075956.003950:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869f8ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.003959:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869f8ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.003966:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869f8ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075956.003989:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787075956.004512:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad6869f8e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623479 expref: 35 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.004531:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869f8ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623479 expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.004539:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:0.0:1787075956.004542:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787075956.004545:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe69a00, rc 0) 00000100:00100000:0.0:1787075956.004701:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+34:10346:x1873884678749824:12345-192.168.204.50@tcp:101:dd.0 Request processed in 22546us (24379us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787075956.004710:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:1.0:1787075956.013326:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075956.013516:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678750208 00000100:00100000:3.0:1787075956.013527:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678750208 00000100:00100000:3.0:1787075956.013803:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:3.0:1787075956.013816:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+34:10346:x1873884678750208:12345-192.168.204.50@tcp:36:dd.0 00010000:00010000:3.0:1787075956.014152:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075956.014173:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075956.014186:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787075956.014267:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1787075956.014295:0:5853:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 0000000076081e1e reply state 0000000044be9d3c transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075956.014305:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787075956.014436:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+37:10346:x1873884678750208:12345-192.168.204.50@tcp:36:dd.0 Request processed in 621us (1122us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787075956.014445:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 52 00000020:00080000:3.0:1787075956.014450:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787075956.016070:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.016088:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.016096:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.016104:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075956.016109:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.016117:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.016136:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:2.0:1787075956.016140:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075956.016146:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.016153:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869f8fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075956.370782:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075956.370948:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678750336 00000100:00100000:2.0:1787075956.370978:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678750336 00000100:00100000:2.0:1787075956.371055:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:2.0:1787075956.371069:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+36:10360:x1873884678750336:12345-192.168.204.50@tcp:101:stat.0 00010000:00010000:2.0:1787075956.371102:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075956.371126:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f902 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623480 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.371196:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f909 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.371222:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f909 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.371235:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f909 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.371254:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f910 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.371261:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.371267:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.371374:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f917 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.371385:0:7654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869f8ed lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623479 expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.371409:0:7654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f917 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.371447:0:7654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869f8ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623479 expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.371460:0:7654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869f8ed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623479 expref: 37 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075956.371487:0:7654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc34000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1873884700799232:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787075956.371612:0:7654:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961876383c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787075956.375260:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075956.375488:0:7654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc34000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1873884700799232:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787075956.375516:0:7654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f917 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075956.375679:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678750592 00000100:00100000:1.0:1787075956.375691:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678750592 00000100:00100000:1.0:1787075956.376844:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:1.0:1787075956.376871:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+38:5599:x1873884678750592:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787075956.377349:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+39:5599:x1873884678750592:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 487us (2095us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787075956.377358:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:1.0:1787075956.383685:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075956.389592:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678750720 00000100:00100000:3.0:1787075956.389615:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678750720 00010000:00010000:3.0:1787075956.389693:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869f8ed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623479 expref: 39 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075956.390059:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:3.0:1787075956.390072:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+39:2362:x1873884678750720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787075956.390094:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075956.390104:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869f8ed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623479 expref: 39 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075956.390120:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869f8ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623479 expref: 39 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075956.390156:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869f8ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623479 expref: 39 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075956.390174:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:3.0:1787075956.390181:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f917 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075956.390193:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075956.390239:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f917 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075956.391098:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075956.391183:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+38:2362:x1873884678750720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1110us (7504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075956.391194:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 39 00010000:00010000:1.0:1787075956.394508:0:7654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.394528:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075956.394586:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787075956.394591:0:7654:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787075956.394674:0:7654:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.394691:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.395097:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f909 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.395106:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f909 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.395113:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f909 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.395120:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075956.395124:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f909 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.395147:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f909 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.395162:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:1.0:1787075956.395165:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075956.395169:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f909 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.395175:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f909 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.395194:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.395211:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f910 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.395218:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f910 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.395223:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075956.395226:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f910 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.395232:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f910 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.395239:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996191b79700) 00010000:00010000:1.0:1787075956.395241:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075956.395244:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f910 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.395259:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f910 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.395305:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f902 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623480 expref: 38 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.395321:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f917 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623480 expref: 37 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.395328:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:1.0:1787075956.395331:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787075956.395333:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032000, rc 0) 00000100:00100000:1.0:1787075956.395406:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+37:10360:x1873884678750336:12345-192.168.204.50@tcp:101:stat.0 Request processed in 24339us (24639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075956.395415:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:1.0:1787075956.426505:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787075956.426534:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700799360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075956.426624:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075956.426747:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700799360 00000100:00100000:2.0:1787075956.426756:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700799360 00000100:00100000:2.0:1787075956.426838:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787075956.426848:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700799360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787075956.426888:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075956.426941:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700799360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075956.426949:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787075956.427016:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700799360:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787075956.427220:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787075956.427481:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700799744:0@lo:400:kworker.0 00000100:00100000:0.0:1787075956.427520:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075956.427544:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787075956.427549:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700799872:0@lo:400:kworker.0 00000100:00100000:0.0:1787075956.427576:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075956.427603:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700799744 00000100:00100000:0.0:1787075956.427625:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700799744 00000100:00100000:0.0:1787075956.427699:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787075956.427707:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700799744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075956.427750:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700799744:12345-0@lo:400:kworker.0 Request processed in 43us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075956.427757:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1787075956.427774:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787075956.427794:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700799744:0@lo:400:kworker.0 00000100:00100000:1.0:1787075956.427895:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700799616:0@lo:400:kworker.0 00000100:00100000:1.0:1787075956.427932:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075956.427953:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787075956.427968:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700799488:0@lo:400:kworker.0 00000100:00100000:1.0:1787075956.427996:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075956.428022:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700800000:0@lo:400:kworker.0 00000100:00100000:1.0:1787075956.428043:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075956.428079:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700799488 00000100:00100000:1.0:1787075956.428083:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700799488 00000100:00100000:1.0:1787075956.428114:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787075956.428120:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3312:x1873884700799488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075956.428156:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3312:x1873884700799488:12345-0@lo:400:kworker.0 Request processed in 36us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075956.428163:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787075956.428207:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700799488:0@lo:400:kworker.0 00000100:00100000:1.0:1787075956.428225:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700799616 00000100:00100000:1.0:1787075956.428228:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700799616 00000100:00100000:1.0:1787075956.428246:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700800000 00000100:00100000:1.0:1787075956.428249:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700800000 00000100:00100000:1.0:1787075956.428263:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787075956.428269:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700799616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075956.428302:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700799616:12345-0@lo:400:kworker.0 Request processed in 33us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075956.428308:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787075956.428318:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787075956.428324:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700800000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075956.428350:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700800000:12345-0@lo:400:kworker.0 Request processed in 27us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075956.428356:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1787075956.428369:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075956.428384:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700800000:0@lo:400:kworker.0 00000100:00100000:1.0:1787075956.428393:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700799616:0@lo:400:kworker.0 00000100:00100000:3.0:1787075956.429011:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700799872 00000100:00100000:3.0:1787075956.429018:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700799872 00000100:00100000:3.0:1787075956.429051:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787075956.429059:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1873884700799872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075956.429116:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1873884700799872:12345-0@lo:400:kworker.0 Request processed in 58us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075956.429124:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787075956.429284:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700799872:0@lo:400:kworker.0 00000100:00100000:1.0:1787075956.491212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075956.491317:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678750976 00000100:00100000:2.0:1787075956.491331:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678750976 00000100:00100000:2.0:1787075956.491397:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:2.0:1787075956.491407:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+37:10366:x1873884678750976:12345-192.168.204.50@tcp:36:truncate.0 00010000:00010000:2.0:1787075956.491485:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075956.491526:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869f917 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623480 expref: 37 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.491550:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:2.0:1787075956.491556:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787075956.492219:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f91e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.492236:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f91e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075956.492245:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f91e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787075956.492295:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787075956.492321:0:7654:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 000000000024bcef reply state 000000000be946a2 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f91e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075956.492329:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787075956.492631:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+39:10366:x1873884678750976:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 1223us (1437us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787075956.492675:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 54 00000020:00080000:2.0:1787075956.492681:0:7654:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787075956.506090:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f91e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.506109:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f91e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.506117:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f91e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.506124:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9033400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075956.506129:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f91e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.506137:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f91e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.506160:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:1.0:1787075956.506163:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075956.506168:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f91e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.506175:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869f91e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.618409:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075956.756446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075956.756550:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678751104 00000100:00100000:0.0:1787075956.756571:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678751104 00000100:00100000:0.0:1787075956.756673:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:0.0:1787075956.756695:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+38:10380:x1873884678751104:12345-192.168.204.50@tcp:101:stat.0 00010000:00010000:0.0:1787075956.756723:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075956.756746:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68200/0x859911ad6869f925 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623487 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.756818:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869f92c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757028:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869f92c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757041:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869f92c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757060:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f933 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757079:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757087:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757314:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869f93a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757323:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869f93a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757329:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869f93a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075956.757370:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787075956.757375:0:5852:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787075956.757401:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869f93a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757413:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869f93a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757422:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869f92c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757427:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869f92c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757434:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869f92c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757452:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075956.757456:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869f92c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757464:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869f92c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757476:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:0.0:1787075956.757478:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075956.757483:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869f92c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757489:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869f92c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757503:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757509:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f933 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757514:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f933 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757520:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075956.757522:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f933 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757528:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f933 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757546:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996191b7a900) 00010000:00010000:0.0:1787075956.757549:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075956.757552:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f933 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757571:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f933 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757606:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68200/0x859911ad6869f925 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623487 expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757619:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869f93a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623487 expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075956.757625:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:0.0:1787075956.757628:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787075956.757630:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe69e00, rc 0) 00000100:00100000:0.0:1787075956.758318:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+39:10380:x1873884678751104:12345-192.168.204.50@tcp:101:stat.0 Request processed in 1629us (1877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075956.758330:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:2.0:1787075956.901873:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075956.904848:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678751360 00000100:00100000:1.0:1787075956.905051:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678751360 00000100:00100000:1.0:1787075956.905209:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:1.0:1787075956.905223:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+39:10390:x1873884678751360:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787075956.905249:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075956.905277:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869f941 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762348e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075956.905417:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787075956.905543:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869f941 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762348e expref: 41 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.905570:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ab00) 00010000:00010000:1.0:1787075956.905573:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787075956.905579:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869f941 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762348e expref: 41 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075956.905594:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf633400, rc 0) 00000100:00100000:1.0:1787075956.907362:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+40:10390:x1873884678751360:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2127us (5484us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1787075956.907377:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:3.0:1787075956.918924:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075956.919577:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678751616 00000100:00100000:2.0:1787075956.919589:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678751616 00000100:00100000:2.0:1787075956.919688:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:2.0:1787075956.919703:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+40:10390:x1873884678751616:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1787075956.919995:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+41:10390:x1873884678751616:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 297us (1080us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787075956.920003:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:3.0:1787075957.017763:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075957.018062:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678751872 00000100:00100000:0.0:1787075957.018075:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678751872 00000100:00100000:0.0:1787075957.018145:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:0.0:1787075957.018157:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+41:10396:x1873884678751872:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1787075957.018197:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075957.018222:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68200/0x859911ad6869f94f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623495 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.018355:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f956 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.018372:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869f93a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623487 expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.018381:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f956 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.018420:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869f93a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623487 expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.018434:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869f93a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623487 expref: 42 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075957.018450:0:5852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1873884700800128:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787075957.018554:0:5852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616540 going to sleep for 11 seconds 00000100:00100000:3.0:1787075957.021203:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075957.021252:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075957.021294:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075957.021493:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678752000 00000100:00100000:0.0:1787075957.021503:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678752000 00000100:00100000:0.0:1787075957.021570:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 282 00000100:00100000:0.0:1787075957.021579:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2359:x1873884678752000:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075957.021634:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678752256 00000100:00100000:2.0:1787075957.021662:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678752256 00000100:00100000:0.0:1787075957.021662:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2359:x1873884678752000:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 83us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075957.021672:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 282 00000100:00100000:2.0:1787075957.021712:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 129 00000100:00100000:2.0:1787075957.021722:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2359:x1873884678752256:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075957.021761:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2359:x1873884678752256:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 42us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075957.021769:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 129 00000100:00100000:3.0:1787075957.023242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075957.023268:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678752384 00000100:00100000:3.0:1787075957.023274:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678752384 00010000:00010000:3.0:1787075957.023310:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869f93a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623487 expref: 43 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075957.023339:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:3.0:1787075957.023347:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+43:2361:x1873884678752384:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787075957.023377:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075957.023384:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869f93a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623487 expref: 43 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.023397:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869f93a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623487 expref: 43 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.023421:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:3.0:1787075957.023426:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f956 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.023435:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f956 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.023443:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f956 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.023462:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075957.023507:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+43:2361:x1873884678752384:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 159us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075957.023515:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 40 00010000:00010000:2.0:1787075957.023555:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869f93a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623487 expref: 42 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075957.023574:0:5852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1873884700800128:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787075957.023597:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f956 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.023607:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f956 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.023613:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f956 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075957.023633:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1787075957.023821:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68200/0x859911ad6869f94f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623495 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.023845:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f956 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623495 expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.023853:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:2.0:1787075957.023856:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787075957.023859:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe69800, rc 0) 00000100:00100000:2.0:1787075957.023889:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+42:10396:x1873884678751872:12345-192.168.204.50@tcp:101:bash.0 Request processed in 5735us (6138us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1787075957.023896:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:1.0:1787075957.024484:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678752128 00000100:00100000:1.0:1787075957.024493:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678752128 00000100:00100000:1.0:1787075957.024547:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:1.0:1787075957.024566:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2359:x1873884678752128:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075957.024624:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2359:x1873884678752128:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 61us (3442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075957.024631:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00080000:1.0:1787075957.024674:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787075957.024679:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787075957.029211:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075957.029403:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678752640 00000100:00100000:3.0:1787075957.029414:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678752640 00000100:00100000:3.0:1787075957.029478:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:3.0:1787075957.029488:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+42:10396:x1873884678752640:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:3.0:1787075957.030278:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f964 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.030304:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f964 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.030337:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f964 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787075957.030400:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1787075957.030430:0:5853:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000a1af1dc0 reply state 00000000f378747e transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f964 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075957.030440:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787075957.033861:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+45:10396:x1873884678752640:12345-192.168.204.50@tcp:36:bash.0 Request processed in 4360us (4660us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1787075957.033948:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 58 00000020:00080000:3.0:1787075957.034031:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787075957.042037:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f964 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.042058:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f964 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.042067:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f964 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.042075:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075957.042080:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f964 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.042089:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f964 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.042110:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:2.0:1787075957.042113:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075957.042118:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f964 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.042149:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869f964 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075957.043196:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075957.043699:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678752768 00000100:00100000:2.0:1787075957.043709:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678752768 00000100:00100000:2.0:1787075957.043773:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:2.0:1787075957.043784:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+44:10396:x1873884678752768:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1787075957.043818:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075957.043839:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f96b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762349c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.043934:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f972 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.043949:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f956 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623495 expref: 45 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.043958:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f972 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.043995:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f956 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623495 expref: 45 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.044007:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f956 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623495 expref: 45 pid: 5852 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075957.044024:0:5852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc36680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1873884700800256:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787075957.044112:0:5852:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187638000 going to sleep for 11 seconds 00000100:00100000:3.0:1787075957.052783:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075957.052924:0:5852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc36680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1873884700800256:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787075957.052953:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f972 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075957.053087:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678752896 00000100:00100000:0.0:1787075957.053095:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678752896 00010000:00010000:0.0:1787075957.053133:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f956 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623495 expref: 46 pid: 5852 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075957.053171:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:0.0:1787075957.053181:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+46:2361:x1873884678752896:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075957.053208:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075957.053216:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f956 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623495 expref: 46 pid: 5852 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.053227:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f956 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623495 expref: 46 pid: 5852 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.053249:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f956 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623495 expref: 46 pid: 5852 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.053264:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:0.0:1787075957.053269:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f972 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.053278:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.053287:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f972 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.053316:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075957.053383:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+45:2361:x1873884678752896:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 202us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075957.053403:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 41 00010000:00010000:2.0:1787075957.053510:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.053517:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075957.053561:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787075957.053565:0:5852:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787075957.053585:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.053612:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f96b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762349c expref: 45 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.053626:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f972 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762349c expref: 44 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.053633:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:2.0:1787075957.053635:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787075957.053678:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032800, rc 0) 00000100:00100000:2.0:1787075957.053705:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+44:10396:x1873884678752768:12345-192.168.204.50@tcp:101:bash.0 Request processed in 9923us (10529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075957.053711:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:3.0:1787075957.058430:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075957.059173:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678753152 00000100:00100000:2.0:1787075957.059200:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678753152 00000100:00100000:2.0:1787075957.059353:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:2.0:1787075957.059388:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b0117450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+44:10396:x1873884678753152:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:2.0:1787075957.059704:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b0117450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+45:10396:x1873884678753152:12345-192.168.204.50@tcp:35:bash.0 Request processed in 320us (1286us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787075957.059712:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:1.0:1787075957.169988:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075957.170087:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678753408 00000100:00100000:2.0:1787075957.170098:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678753408 00000100:00100000:2.0:1787075957.170160:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:2.0:1787075957.170171:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+45:10406:x1873884678753408:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787075957.170938:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075957.170968:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f979 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76234a3 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075957.171110:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787075957.171559:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f979 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234a3 expref: 47 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.171590:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ab00) 00010000:00010000:2.0:1787075957.171593:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787075957.171600:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f979 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234a3 expref: 47 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.171618:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032400, rc 0) 00000100:00100000:2.0:1787075957.171839:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+46:10406:x1873884678753408:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1668us (1858us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787075957.171851:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:3.0:1787075957.176034:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075957.176147:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678753536 00000100:00100000:1.0:1787075957.176157:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678753536 00000100:00100000:1.0:1787075957.176241:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:1.0:1787075957.176264:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+46:10406:x1873884678753536:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:1.0:1787075957.176363:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869f987 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176382:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869f987 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176394:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869f987 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176409:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869f98e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176416:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869f98e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176422:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869f98e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176531:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f995 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176540:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176547:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787075957.176595:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176606:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869f987 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176619:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869f987 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176625:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869f987 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176631:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632e00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075957.176636:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869f987 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176672:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869f987 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176686:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:1.0:1787075957.176689:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075957.176694:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869f987 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176700:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869f987 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176719:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869f98e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176724:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869f98e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176730:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869f98e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176735:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075957.176746:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869f98e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176751:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869f98e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176759:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996187c34100) 00010000:00010000:1.0:1787075957.176761:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075957.176764:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869f98e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176769:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869f98e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176785:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176791:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f995 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176797:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176801:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075957.176804:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176809:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f995 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176816:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:1.0:1787075957.176818:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075957.176827:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f995 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.176833:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f995 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075957.176934:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+46:10406:x1873884678753536:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 670us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075957.176943:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:3.0:1787075957.179907:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075957.180037:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678753792 00000100:00100000:1.0:1787075957.180051:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678753792 00000100:00100000:1.0:1787075957.180118:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:1.0:1787075957.180130:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+46:10406:x1873884678753792:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1787075957.180443:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+47:10406:x1873884678753792:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 314us (546us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787075957.180452:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:3.0:1787075957.243784:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075957.243891:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678754048 00000100:00100000:0.0:1787075957.243905:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678754048 00000100:00100000:0.0:1787075957.243979:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:0.0:1787075957.243990:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+47:10409:x1873884678754048:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787075957.244016:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075957.244040:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f99c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76234aa expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244123:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869f9a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244137:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869f9a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244161:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869f9a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244178:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869f9aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244196:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869f9aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244203:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869f9aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244355:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68200/0x859911ad6869f9b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244380:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68200/0x859911ad6869f9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244388:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68200/0x859911ad6869f9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075957.244408:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787075957.244509:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869f9a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244518:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869f9a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244525:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869f9a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244531:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68e00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075957.244535:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869f9a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244543:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869f9a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244557:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:0.0:1787075957.244560:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075957.244564:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869f9a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244569:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869f9a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244583:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869f9aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244597:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869f9aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244603:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869f9aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244608:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075957.244611:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869f9aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244617:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869f9aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244626:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996191b7a900) 00010000:00010000:0.0:1787075957.244628:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075957.244631:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869f9aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244636:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869f9aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244758:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f99c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234aa expref: 50 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244771:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68200/0x859911ad6869f9b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234aa expref: 49 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.244778:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:0.0:1787075957.244780:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787075957.244789:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe68200, rc 0) 00000100:00100000:0.0:1787075957.244857:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+49:10409:x1873884678754048:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 868us (1085us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787075957.244866:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:0.0:1787075957.249326:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075957.249550:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678754176 00000100:00100000:1.0:1787075957.249572:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678754176 00000100:00100000:1.0:1787075957.249636:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:1.0:1787075957.249670:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+49:10409:x1873884678754176:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:1.0:1787075957.249749:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f9bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.249766:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f9bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.249778:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f9bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.249808:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f9bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.249826:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f9bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.249833:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f9bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.249839:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075957.249843:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f9bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.249851:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f9bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.249862:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:1.0:1787075957.249865:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787075957.249870:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f9bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.249876:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f9bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075957.249955:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+49:10409:x1873884678754176:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 287us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075957.249963:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:3.0:1787075957.250637:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075957.251338:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678754304 00000100:00100000:0.0:1787075957.251349:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678754304 00000100:00100000:0.0:1787075957.251420:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:0.0:1787075957.251431:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+49:2361:x1873884678754304:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075957.251446:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075957.251469:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68200/0x859911ad6869f9b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234aa expref: 49 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.251486:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:0.0:1787075957.251489:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075957.251547:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+48:2361:x1873884678754304:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 119us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075957.251555:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:3.0:1787075957.263077:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075957.263515:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678754560 00000100:00100000:1.0:1787075957.263528:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678754560 00000100:00100000:1.0:1787075957.263600:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:1.0:1787075957.263613:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+48:10409:x1873884678754560:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1787075957.264324:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+49:10409:x1873884678754560:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 710us (1257us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787075957.264784:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:3.0:1787075957.448235:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:2.0:1787075957.448235:0:6986:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339423590951ns, next at 340423587060ns, rc = 0 00000100:00100000:3.0:1787075957.448269:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bfc36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700800384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787075957.448445:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075957.448933:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700800384 00000100:00100000:0.0:1787075957.448945:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700800384 00000100:00100000:0.0:1787075957.449087:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787075957.449099:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1873884700800384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787075957.449173:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787075957.449250:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1873884700800384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075957.449258:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787075957.451996:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bfc36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700800384:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787075957.456312:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787075957.471514:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075957.471634:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678754816 00000100:00100000:0.0:1787075957.471813:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678754816 00000100:00100000:0.0:1787075957.471925:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:0.0:1787075957.471937:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+49:10427:x1873884678754816:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1787075957.471972:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075957.471993:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68200/0x859911ad6869f9c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76234b1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.472152:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f9cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.472166:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f9cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.472189:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f9cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075957.472202:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787075957.472679:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68200/0x859911ad6869f9c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234b1 expref: 52 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.472699:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f9cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234b1 expref: 51 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.472707:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:0.0:1787075957.472710:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787075957.472713:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe69800, rc 0) 00000100:00100000:0.0:1787075957.472793:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+51:10427:x1873884678754816:12345-192.168.204.50@tcp:101:cat.0 Request processed in 857us (1295us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787075957.472802:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:3.0:1787075957.511687:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075957.511814:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678754944 00000100:00100000:1.0:1787075957.511826:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678754944 00000100:00100000:1.0:1787075957.511958:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:1.0:1787075957.511971:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+51:10428:x1873884678754944:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787075957.512004:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075957.512040:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f9db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76234b8 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.512128:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869f9e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.512144:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869f9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.512157:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869f9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075957.512232:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787075957.512236:0:5854:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787075957.512510:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869f9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.512543:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869f9db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234b8 expref: 53 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.512564:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869f9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234b8 expref: 52 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.512592:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:1.0:1787075957.512595:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787075957.512599:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632e00, rc 0) 00000100:00100000:1.0:1787075957.512843:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:10428:x1873884678754944:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 874us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075957.512853:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:3.0:1787075957.523593:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075957.523798:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678755328 00000100:00100000:2.0:1787075957.523811:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678755328 00000100:00100000:2.0:1787075957.523891:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:2.0:1787075957.523904:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:10428:x1873884678755328:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1787075957.524615:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+53:10428:x1873884678755328:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 709us (1029us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787075957.524627:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:0.0:1787075957.528591:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075957.529380:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678755456 00000100:00100000:2.0:1787075957.529398:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678755456 00000100:00100000:2.0:1787075957.529517:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:2.0:1787075957.529533:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+53:10428:x1873884678755456:12345-192.168.204.50@tcp:103:lfs.0 00010000:00010000:2.0:1787075957.529554:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787075957.529589:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f972 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762349c expref: 53 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.529615:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869f9cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234b1 expref: 52 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.529629:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869f87d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762345d expref: 51 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.529697:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34400) 00010000:00010000:2.0:1787075957.529710:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075957.529786:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+50:10428:x1873884678755456:12345-192.168.204.50@tcp:103:lfs.0 Request processed in 257us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075957.529802:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:3.0:1787075957.534064:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075957.534298:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678755584 00000100:00100000:2.0:1787075957.534311:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678755584 00000100:00100000:2.0:1787075957.534384:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00100000:2.0:1787075957.534394:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+50:10428:x1873884678755584:12345-192.168.204.50@tcp:58:lfs.0 00010000:00010000:2.0:1787075957.534501:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f9e9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.534519:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f9e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.534530:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f9e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787075957.535405:0:7654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787075957.535636:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787075957.535737:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787075957.535869:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+50:10428:x1873884678755584:12345-192.168.204.50@tcp:58:lfs.0 Request processed in 1469us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075957.537533:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00100000:1.0:1787075957.569626:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075957.570246:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678755712 00000100:00100000:2.0:1787075957.570258:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678755712 00000100:00100000:2.0:1787075957.570341:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:2.0:1787075957.570352:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+50:10430:x1873884678755712:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787075957.570375:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075957.570397:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f9f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76234bf expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.570493:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f9f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.570518:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f9f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.570529:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f9f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.570546:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f9fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.570553:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f9fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075957.570560:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f9fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571587:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fa05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571617:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fa05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571626:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fa05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075957.571696:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787075957.571701:0:5852:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787075957.571720:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fa05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571731:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fa05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571740:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f9f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571746:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f9f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571753:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f9f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571760:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075957.571764:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f9f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571772:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f9f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571784:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:3.0:1787075957.571788:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075957.571798:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f9f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571805:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869f9f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571822:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f9fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571828:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f9fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571834:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f9fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571840:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075957.571843:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f9fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571850:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f9fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571858:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996191b79f00) 00010000:00010000:3.0:1787075957.571860:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075957.571863:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f9fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571919:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869f9fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.571971:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869f9f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234bf expref: 52 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.572000:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fa05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234bf expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075957.572008:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996191b79800) 00010000:00010000:3.0:1787075957.572010:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787075957.572013:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523000, rc 0) 00000100:00100000:3.0:1787075957.572152:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+51:10430:x1873884678755712:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1801us (2541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075957.572162:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 67 00010000:00010000:1.0:1787075957.641201:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787075957.960194:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787075957.960206:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787075957.960284:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787075957.960292:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787075957.960453:0:11694:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94bad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1873884700800512:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787075957.960629:0:11694:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616540 going to sleep for 11 seconds 00000100:00100000:1.0:1787075957.971852:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075957.973906:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678755840 00000100:00100000:3.0:1787075957.973928:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678755840 00000100:00100000:3.0:1787075957.974033:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:3.0:1787075957.974044:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:10441:x1873884678755840:12345-192.168.204.50@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787075957.974309:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:10441:x1873884678755840:12345-192.168.204.50@tcp:900:lhsmtool_posix.0 Request processed in 266us (2463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075957.974317:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:0.0:1787075957.975505:0:11694:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94bad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1873884700800512:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787075957.979736:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075957.979900:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678755968 00000100:00100000:0.0:1787075957.979913:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678755968 00000100:00100000:0.0:1787075957.979992:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:0.0:1787075957.980120:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+51:10441:x1873884678755968:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787075957.980156:0:5853:0:(mdt_handler.c:8026:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787075957.980286:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+51:10441:x1873884678755968:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 170us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075957.986772:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:3.0:1787075957.991503:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075957.991607:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678756096 00000100:00100000:0.0:1787075957.991621:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678756096 00000100:00100000:0.0:1787075957.991720:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:0.0:1787075957.991733:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+51:10441:x1873884678756096:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787075957.991847:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fa0c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.991867:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fa0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.991881:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fa0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.991912:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fa13 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.991921:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fa13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.991928:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fa13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.991956:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fa1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.991966:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fa1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.991973:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fa1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075957.992253:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787075957.992260:0:5854:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787075957.992282:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fa1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.992297:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fa0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.992308:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fa0c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.992742:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fa0c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.992760:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69e00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075957.992766:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fa0c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.992837:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fa0c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.992854:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996191b79600) 00010000:00010000:0.0:1787075957.992857:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075957.992863:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fa0c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.992869:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fa0c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.992887:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fa13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.992893:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fa13 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.992898:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fa13 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.992903:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075957.992906:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fa13 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.992912:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fa13 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.992933:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff996191b7a900) 00010000:00010000:0.0:1787075957.992936:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075957.993098:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fa13 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.993178:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fa13 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.993201:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fa1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.993208:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fa1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.993214:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fa1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.993219:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075957.993222:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fa1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.993228:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fa1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.993237:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996191b79800) 00010000:00010000:0.0:1787075957.993240:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075957.993243:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fa1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075957.993248:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fa1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075957.993489:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+51:10441:x1873884678756096:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 Request processed in 1755us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075957.993499:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:3.0:1787075957.997350:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075957.997523:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678756352 00000100:00100000:1.0:1787075957.997538:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678756352 00000100:00100000:1.0:1787075957.997612:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:1.0:1787075957.997624:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+51:10441:x1873884678756352:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787075957.997687:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075957.997716:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fa21 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76234c6 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.997858:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fa28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.997876:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fa28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.997889:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fa28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075957.997901:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787075957.998069:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fa28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.998077:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fa28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.998084:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fa28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.998090:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075957.998094:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fa28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.998247:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fa28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.998262:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996191b79800) 00010000:00010000:1.0:1787075957.998265:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787075957.998270:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fa28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.998275:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fa28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.998393:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fa21 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234c6 expref: 53 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.998403:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996191b79600) 00010000:00010000:1.0:1787075957.998405:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787075957.998409:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fa21 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234c6 expref: 53 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075957.998429:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf633600, rc 0) 00000100:00100000:1.0:1787075957.998503:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:10441:x1873884678756352:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 880us (1172us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1787075957.998513:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:3.0:1787075958.003050:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075958.003666:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678756480 00000100:00100000:0.0:1787075958.003677:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678756480 00000100:00100000:0.0:1787075958.003750:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 71 00000100:00100000:0.0:1787075958.003761:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:10441:x1873884678756480:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787075958.003814:0:5852:0:(mdt_handler.c:8026:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787075958.004524:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:10441:x1873884678756480:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 762us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075958.004535:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 71 00000100:00080000:2.0:1787075958.006208:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075958.011862:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075958.012388:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678756736 00000100:00100000:1.0:1787075958.012400:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678756736 00000100:00100000:1.0:1787075958.012451:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00100000:1.0:1787075958.012461:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:10441:x1873884678756736:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787075958.012482:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075958.012485:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787075958.012514:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869f9e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234b8 expref: 52 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.012531:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:1.0:1787075958.012536:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787075958.012549:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fa36 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76234cd expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787075958.013420:0:7654:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787075958.013669:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fa3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.013686:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fa3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.013698:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fa3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.013783:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fa36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234cd expref: 54 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.013800:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fa3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234cd expref: 53 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.013809:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996187c34100) 00010000:00010000:1.0:1787075958.013812:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787075958.013815:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632c00, rc 0) 00000100:00100000:1.0:1787075958.013895:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+53:10441:x1873884678756736:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1435us (2044us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787075958.013904:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00100000:3.0:1787075958.022537:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075958.022695:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678756992 00000100:00100000:1.0:1787075958.022708:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678756992 00000100:00100000:1.0:1787075958.022777:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:1.0:1787075958.022788:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+53:10441:x1873884678756992:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787075958.022869:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075958.022907:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fa3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234cd expref: 53 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.022928:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996187c34100) 00010000:00010000:1.0:1787075958.022939:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787075958.022970:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fa4b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.022985:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fa4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.023013:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fa4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.023031:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7ddc44f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.023038:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ddc44f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.023044:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ddc44f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.023149:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fa4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.023156:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fa4b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.023162:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fa4b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.023177:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075958.023181:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fa4b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.023188:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fa4b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.023197:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:1.0:1787075958.023199:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075958.023203:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fa4b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.023216:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fa4b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.023226:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ddc44f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.023232:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ddc44f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.023238:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ddc44f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.023243:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075958.023247:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ddc44f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.023252:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ddc44f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.023260:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7ddc44f8 (ffff996187c34500) 00010000:00010000:1.0:1787075958.023262:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075958.023264:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa52 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7ddc44f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.023270:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7ddc44f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075958.023368:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:10441:x1873884678756992:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 583us (845us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787075958.023375:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:3.0:1787075958.026870:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075958.027881:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678757120 00000100:00100000:1.0:1787075958.027895:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678757120 00000100:00100000:1.0:1787075958.027965:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00100000:1.0:1787075958.027976:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:10441:x1873884678757120:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787075958.028007:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075958.028034:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fa59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76234d4 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.028080:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869fa60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.028094:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869fa60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.028116:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869fa60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.028231:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fa59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234d4 expref: 54 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.028248:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869fa60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234d4 expref: 53 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.028255:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996187c34e00) 00010000:00010000:1.0:1787075958.028258:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787075958.028261:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632e00, rc 0) 00000100:00100000:1.0:1787075958.028344:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+53:10441:x1873884678757120:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 370us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075958.028352:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00100000:0.0:1787075958.042601:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075958.042672:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678757376 00000100:00100000:1.0:1787075958.042697:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678757376 00000100:00100000:1.0:1787075958.043876:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:1.0:1787075958.043890:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+53:10441:x1873884678757376:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787075958.044234:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.044253:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.044266:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787075958.044696:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1787075958.045204:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340020562103ns, next at 341020557097ns, rc = 0 00000004:00010000:1.0:1787075958.045392:0:5852:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000c1d50dfc reply state 0000000074706634 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075958.045407:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787075958.045555:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:10441:x1873884678757376:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 1664us (2961us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787075958.045566:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:0.0:1787075958.055683:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075958.055867:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678757504 00000100:00100000:2.0:1787075958.055881:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678757504 00000100:00100000:2.0:1787075958.055968:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 76 00000100:00100000:2.0:1787075958.055978:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:10441:x1873884678757504:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787075958.056018:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075958.056043:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fa6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76234db expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.056118:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fa6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234db expref: 56 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.056132:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fa6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234db expref: 56 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.056178:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996187c34e00) 00010000:00010000:2.0:1787075958.056181:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787075958.056184:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9033400, rc 0) 00000100:00100000:2.0:1787075958.056247:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+56:10441:x1873884678757504:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 271us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075958.056254:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 76 00010000:00010000:3.0:1787075958.058574:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.058603:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.058611:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.058618:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075958.058624:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.058632:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa67 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.059175:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996187c34e00) 00010000:00010000:3.0:1787075958.059180:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787075958.059186:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa67 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.059192:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fa67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075958.066205:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075958.066318:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678757632 00000100:00100000:1.0:1787075958.066329:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678757632 00000100:00100000:1.0:1787075958.066380:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:1.0:1787075958.066388:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1873884678757632:12345-192.168.204.50@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1787075958.066425:0:6706:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:1.0:1787075958.066458:0:6706:0:(genops.c:1406:class_connect()) connect: client a850c61f-0242-4b36-8952-7b46dff1f2b9, cookie 0x859911ad6869fa75 00002000:00100000:1.0:1787075958.066472:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a850c61f-0242-4b36-8952-7b46dff1f2b9/ffff9961a6f22000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787075958.066510:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787075958.066891:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787075958.066927:0:6706:0:(import.c:65:import_set_state_nolock()) ffff9961a6f21000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787075958.067006:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2358:x1873884678757632:12345-192.168.204.50@tcp:8:lhsmtool_posix.0 Request processed in 617us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075958.067016:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:0.0:1787075958.077915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075958.078109:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678757760 00000100:00100000:3.0:1787075958.078119:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678757760 00000100:00100000:3.0:1787075958.078204:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:3.0:1787075958.078216:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:0:x1873884678757760:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787075958.078560:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1787075958.114386:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a850c61f-0242-4b36-8952-7b46dff1f2b9 00000001:00080000:0.0:1787075958.114410:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1787075958.119557:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:0:x1873884678757760:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 41330us (41645us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787075958.119574:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:3.0:1787075958.124425:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075958.125923:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678758016 00000100:00100000:2.0:1787075958.125939:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678758016 00000100:00100000:2.0:1787075958.126142:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:2.0:1787075958.126156:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:10441:x1873884678758016:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787075958.126481:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+56:10441:x1873884678758016:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 327us (2074us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787075958.126489:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:0.0:1787075958.133177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075958.133609:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678758272 00000100:00100000:3.0:1787075958.133620:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678758272 00000100:00100000:3.0:1787075958.134604:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:3.0:1787075958.134618:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+56:10441:x1873884678758272:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787075958.134809:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+56:10441:x1873884678758272:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 194us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075958.134818:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:0.0:1787075958.138749:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075958.138864:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678758400 00000100:00100000:2.0:1787075958.138875:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678758400 00000100:00100000:2.0:1787075958.138928:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:2.0:1787075958.138938:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+56:10441:x1873884678758400:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787075958.138961:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075958.138982:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fa7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76234e2 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.139074:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fa83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.139090:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fa83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.139102:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fa83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075958.139138:0:7654:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787075958.139157:0:7654:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fa83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.139196:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fa7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234e2 expref: 58 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.139214:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fa83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234e2 expref: 57 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.139222:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996187c34e00) 00010000:00010000:2.0:1787075958.139224:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787075958.139229:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032600, rc 0) 00000100:00100000:2.0:1787075958.139289:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+57:10441:x1873884678758400:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 353us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075958.139297:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:2.0:1787075958.143301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075958.143470:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678758528 00000100:00100000:1.0:1787075958.143482:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678758528 00000100:00100000:1.0:1787075958.143545:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:1.0:1787075958.143555:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678758528:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787075958.143574:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075958.143599:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000598af6be/0x859911ad6869fa8a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76234e9 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787075958.143628:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a849d76, blocks: 0x1 00010000:00010000:1.0:1787075958.143664:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:1.0:1787075958.143669:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787075958.143681:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000598af6be/0x859911ad6869fa8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234e9 expref: 6 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.143701:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000598af6be/0x859911ad6869fa8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234e9 expref: 6 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.143716:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf633600, rc 0) 00000100:00100000:1.0:1787075958.144520:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2362:x1873884678758528:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 959us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075958.144546:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:3.0:1787075958.147972:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075958.148191:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678758784 00000100:00100000:0.0:1787075958.148200:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678758784 00000100:00100000:0.0:1787075958.148267:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:0.0:1787075958.148279:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+57:10441:x1873884678758784:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787075958.148560:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+57:10441:x1873884678758784:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 282us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075958.148581:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:0.0:1787075958.152427:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075958.152540:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678758912 00000100:00100000:3.0:1787075958.152549:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678758912 00000100:00100000:3.0:1787075958.152612:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:3.0:1787075958.152623:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:10441:x1873884678758912:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787075958.152668:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075958.152691:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad6869fa91 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76234f0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.152727:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000598af6be/0x859911ad6869fa8a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234e9 expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.152737:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787075958.152742:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787075958.152747:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad6869fa91 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234f0 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.152914:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000598af6be/0x859911ad6869fa8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234e9 expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.152929:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000598af6be/0x859911ad6869fa8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234e9 expref: 7 pid: 6706 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075958.152964:0:6705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f55f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1873884700800640:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787075958.153096:0:6705:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961877aba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787075958.160206:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075958.160584:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678759040 00000100:00100000:0.0:1787075958.160597:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678759040 00010000:00010000:0.0:1787075958.160683:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000598af6be/0x859911ad6869fa8a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234e9 expref: 8 pid: 6706 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075958.160726:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:0.0:1787075958.160737:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a03cb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2362:x1873884678759040:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075958.160753:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075958.160789:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000598af6be/0x859911ad6869fa8a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234e9 expref: 8 pid: 6706 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.160805:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000598af6be/0x859911ad6869fa8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234e9 expref: 8 pid: 6706 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.160838:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787075958.160843:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787075958.160852:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad6869fa91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234f0 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.160864:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad6869fa91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234f0 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.161109:0:8465:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad6869fa91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234f0 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075958.161145:0:8465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94ba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8465:1873884700800768:192.168.204.50@tcp:105: 00000100:00100000:0.0:1787075958.161248:0:8465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616600 going to sleep for 11 seconds 00010000:00010000:3.0:1787075958.161576:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000598af6be/0x859911ad6869fa8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234e9 expref: 8 pid: 6706 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075958.161591:0:6705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f55f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1873884700800640:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075958.161616:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad6869fa91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234f0 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.161628:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522a00, rc 0) 00000100:00100000:3.0:1787075958.161703:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:10441:x1873884678758912:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 9082us (9286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075958.161712:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:0.0:1787075958.175750:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075958.176400:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678759168 00000100:00100000:1.0:1787075958.176413:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678759168 00002000:00100000:1.0:1787075958.176476:0:6711:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9961b94bb800 x1873884678759168/t0(0) o4->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:29/0 lens 504/0 e 0 to 0 dl 1787075969 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787075958.176488:0:6711:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961b94bb800 with x1873884678759168 ext(0->8) 00002000:00010000:1.0:1787075958.176494:0:6711:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9961b94bb800 00000100:00100000:1.0:1787075958.176537:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:1.0:1787075958.176549:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2361:x1873884678759168:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787075958.177271:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:2361:x1873884678759168:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 Request processed in 721us (1529us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787075958.177280:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00002000:00100000:1.0:1787075958.177288:0:6711:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9961b94bb800 x1873884678759168/t4294967302(0) o4->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:29/0 lens 504/448 e 0 to 0 dl 1787075969 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787075958.177297:0:6711:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961b94bb800 with x1873884678759168 ext(0->8) 00002000:00010000:1.0:1787075958.177301:0:6711:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9961b94bb800 00000100:00100000:3.0:1787075958.184020:0:8465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94ba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8465:1873884700800768:192.168.204.50@tcp:105: 00010000:00010000:3.0:1787075958.184054:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075958.188174:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a03cb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2362:x1873884678759040:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 27411us (27952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075958.188186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075958.188197:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:2.0:1787075958.188341:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678759296 00000100:00100000:2.0:1787075958.188350:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678759296 00000100:00100000:2.0:1787075958.188405:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 80 00000100:00100000:2.0:1787075958.188416:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+57:10441:x1873884678759296:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787075958.292427:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:0.0:1787075958.292468:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1787075958.292473:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:0.0:1787075958.292498:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1787075958.292513:0:5874:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996189361a80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787075958.292519:0:5874:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99618763e400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996189361240 00000020:00080000:0.0:1787075958.292522:0:5874:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9961c1f3fa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9961bedb5c00 00000001:00080000:0.0:1787075958.292537:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1787075958.292544:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787075958.292780:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1787075958.292904:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787075958.292924:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700800896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787075958.296756:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:10441:x1873884678759296:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 Request processed in 108322us (108556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075958.296791:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 80 00000100:00100000:0.0:1787075958.299582:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075958.299704:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787075958.299719:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700801024:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787075958.299789:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075958.300441:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700800896 00000100:00100000:1.0:1787075958.300453:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700800896 00000100:00100000:1.0:1787075958.300517:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700801024 00000100:00100000:1.0:1787075958.300521:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700801024 00000100:00100000:1.0:1787075958.300546:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787075958.300554:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700800896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787075958.300802:0:8477:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787075958.300806:0:8477:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787075958 00002000:00010000:1.0:1787075958.300815:0:8477:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787075958.300817:0:8477:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787075958 -> 1787075958 00002000:00010000:1.0:1787075958.300820:0:8477:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787075958.300892:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1873884700800896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 338us (1317us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787075958.300900:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787075958.300918:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787075958.300926:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1873884700801024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787075958.300940:0:8477:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787075958.300966:0:8477:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a849d73, atime: 0x6a849d73, ctime: 0x6a849d73, blocks: 0x1 00010000:00010000:1.0:1787075958.300973:0:8477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ab21fd/0x859911ad6869fa98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.301078:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=340s v=(0 0) 00010000:00010000:1.0:1787075958.301084:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787075958.301091:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ab21fd/0x859911ad6869fa98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.301190:0:8477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ab21fd/0x859911ad6869fa98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.301201:0:8477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ab21fd/0x859911ad6869fa98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.301209:0:8477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ab21fd/0x859911ad6869fa98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.301237:0:8477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787075958.301543:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9961b94b8e00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1787075958.301551:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700800896:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1787075958.301575:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787075958.301581:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ab21fd/0x859911ad6869fa98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.301590:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632400 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787075958.301594:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ab21fd/0x859911ad6869fa98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.301604:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ab21fd/0x859911ad6869fa98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.301621:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ab21fd/0x859911ad6869fa98 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.301628:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ab21fd/0x859911ad6869fa98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.301663:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075958.301666:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075958.301668:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075958.302887:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1873884700801024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1959us (3094us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787075958.302899:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787075958.302932:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1787075958.305313:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9961b94b8000/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787075958.305329:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700801024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787075958.308825:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075958.308912:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678759424 00000100:00100000:0.0:1787075958.308924:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678759424 00000100:00100000:0.0:1787075958.308986:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:0.0:1787075958.308999:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2362:x1873884678759424:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787075958.355541:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2362:x1873884678759424:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 Request processed in 46533us (46713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075958.355555:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 30 00000001:00080000:0.0:1787075958.355589:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1787075958.355598:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1787075958.365957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075958.366490:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678759680 00000100:00100000:0.0:1787075958.366502:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678759680 00000100:00100000:0.0:1787075958.366563:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00100000:0.0:1787075958.366574:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:10441:x1873884678759680:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787075958.366674:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075958.366704:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fa83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234e2 expref: 13 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.366729:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996187c34e00) 00010000:00010000:0.0:1787075958.366734:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787075958.366781:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fa9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.366797:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fa9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.366809:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fa9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787075958.367108:0:5852:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000a73f3c6b reply state 0000000048ff12d8 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fa9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075958.367118:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787075958.367239:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:10441:x1873884678759680:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 665us (1294us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787075958.367247:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00100000:3.0:1787075958.371493:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1787075958.371745:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fa9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.371758:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fa9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.371772:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fa9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.371780:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075958.371785:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fa9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.371794:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fa9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.371812:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996187c34e00) 00010000:00010000:0.0:1787075958.371815:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075958.371820:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fa9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.371827:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fa9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075958.375220:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678759808 00000100:00100000:1.0:1787075958.375237:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678759808 00000100:00100000:1.0:1787075958.375391:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:1.0:1787075958.375404:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2362:x1873884678759808:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787075958.375720:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787075958.375724:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787075958 -> 1787075957 00002000:00010000:1.0:1787075958.375726:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787075955 00002000:00010000:1.0:1787075958.375728:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787075958 -> 1787075957 00002000:00010000:1.0:1787075958.375731:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787075958.376862:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2362:x1873884678759808:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 1455us (5376us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787075958.376874:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 31 00000040:00080000:1.0:1787075958.394703:0:12010:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787075958.394716:0:12010:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787075958.394788:0:12010:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787075958.394795:0:12010:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787075958.396586:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075958.400607:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678760064 00000100:00100000:0.0:1787075958.400625:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678760064 00000100:00100000:0.0:1787075958.400720:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:0.0:1787075958.400731:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:10441:x1873884678760064:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787075958.400826:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869faa6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.400846:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869fa60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234d4 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.400856:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869faa6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.400892:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869fa60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234d4 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.400907:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869fa60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234d4 expref: 13 pid: 5853 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075958.400922:0:5853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1873884700801152:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787075958.401016:0:5853:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191332540 going to sleep for 11 seconds 00000100:00100000:2.0:1787075958.406495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075958.406529:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678760192 00000100:00100000:2.0:1787075958.406537:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678760192 00010000:00010000:2.0:1787075958.406585:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869fa60 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234d4 expref: 14 pid: 5853 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075958.406625:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:2.0:1787075958.406635:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:2362:x1873884678760192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075958.406675:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075958.406682:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869fa60 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234d4 expref: 14 pid: 5853 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.406695:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869fa60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234d4 expref: 14 pid: 5853 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.406718:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996187c34e00) 00010000:00010000:2.0:1787075958.406724:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869faa6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.406734:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869faa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.406742:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869faa6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.406773:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075958.406837:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:2362:x1873884678760192:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 203us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075958.406845:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 43 00010000:00010000:3.0:1787075958.407257:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869fa60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234d4 expref: 13 pid: 5853 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075958.407284:0:5853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1873884700801152:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075958.407323:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869faa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.407333:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869faa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.407339:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869faa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.407369:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869faa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.407377:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869faa6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.407384:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869faa6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.407390:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075958.407395:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869faa6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.407403:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869faa6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.407414:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996187c34e00) 00010000:00010000:3.0:1787075958.407417:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787075958.407422:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869faa6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.407434:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869faa6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075958.407490:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+12:10441:x1873884678760064:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 Request processed in 6762us (10912us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787075958.407501:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:3.0:1787075958.411529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075958.411630:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678760320 00000100:00100000:2.0:1787075958.411667:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678760320 00000100:00100000:2.0:1787075958.411730:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:2.0:1787075958.411739:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2361:x1873884678760320:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787075958.411796:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004be8e94f/0x859911ad6869faad lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.411817:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad6869fa91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234f0 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.411826:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787075958.411831:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787075958.411834:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004be8e94f/0x859911ad6869faad lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.411869:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad6869fa91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234f0 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.411894:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad6869fa91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234f0 expref: 7 pid: 6705 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075958.411909:0:6704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1880380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1873884700801280:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787075958.412010:0:6704:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187638e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787075958.421860:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075958.423619:0:6704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1880380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1873884700801280:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075958.423689:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004be8e94f/0x859911ad6869faad lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075958.424171:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678760448 00000100:00100000:0.0:1787075958.424180:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678760448 00010000:00010000:0.0:1787075958.424226:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad6869fa91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234f0 expref: 8 pid: 6705 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075958.424270:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:0.0:1787075958.424281:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2362:x1873884678760448:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075958.424295:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075958.424334:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad6869fa91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234f0 expref: 8 pid: 6705 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.424372:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad6869fa91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234f0 expref: 8 pid: 6705 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.424400:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad6869fa91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234f0 expref: 8 pid: 6705 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.424422:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787075958.424427:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787075958.424434:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004be8e94f/0x859911ad6869faad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.424446:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004be8e94f/0x859911ad6869faad lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.424481:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075958.424543:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2362:x1873884678760448:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 264us (2693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075958.424552:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 44 00010000:00010000:3.0:1787075958.424808:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004be8e94f/0x859911ad6869faad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.424818:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004be8e94f/0x859911ad6869faad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.424861:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004be8e94f/0x859911ad6869faad lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.424871:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004be8e94f/0x859911ad6869faad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.424879:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004be8e94f/0x859911ad6869faad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.424900:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032800 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787075958.424905:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004be8e94f/0x859911ad6869faad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.424917:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004be8e94f/0x859911ad6869faad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.424934:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004be8e94f/0x859911ad6869faad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.424942:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004be8e94f/0x859911ad6869faad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075958.425008:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2361:x1873884678760320:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 Request processed in 13269us (13495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075958.425016:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:1.0:1787075958.429586:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075958.429684:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678760704 00000100:00100000:0.0:1787075958.429694:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678760704 00000100:00100000:0.0:1787075958.429742:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 83 00000100:00100000:0.0:1787075958.429751:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+12:10441:x1873884678760704:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787075958.429843:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fab4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.429860:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.429883:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.430086:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869fabb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.430097:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fa6e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234db expref: 13 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.430105:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869fabb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.430139:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fa6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234db expref: 13 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.430152:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fa6e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234db expref: 13 pid: 7654 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075958.430179:0:5852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1873884700801408:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787075958.430261:0:5852:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191860c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787075958.437913:0:5852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1873884700801408:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787075958.437947:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869fabb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075958.439441:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075958.439845:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678760832 00000100:00100000:2.0:1787075958.439858:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678760832 00010000:00010000:2.0:1787075958.439909:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fa6e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234db expref: 14 pid: 7654 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075958.439954:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:2.0:1787075958.439965:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:2361:x1873884678760832:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075958.439982:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075958.439989:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fa6e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234db expref: 14 pid: 7654 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.440002:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fa6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234db expref: 14 pid: 7654 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.440025:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fa6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234db expref: 14 pid: 7654 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.440041:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996187c34e00) 00010000:00010000:2.0:1787075958.440047:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869fabb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.440056:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869fabb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.440064:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869fabb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075958.440087:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075958.440170:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:2361:x1873884678760832:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 197us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075958.440178:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 45 00010000:00010000:0.0:1787075958.440353:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869fabb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.440363:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869fabb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787075958.440557:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1787075958.440742:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1787075958.440789:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1787075958.440880:0:5852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1873884700801536:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787075958.440931:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075958.440965:0:5852:0:(client.c:2702:ptlrpc_set_wait()) set ffff99619a2ab600 going to sleep for 11 seconds 00000100:00100000:2.0:1787075958.441315:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700801536 00000100:00100000:2.0:1787075958.441323:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700801536 00000100:00100000:2.0:1787075958.441370:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787075958.441381:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1873884700801536:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787075958.441489:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1873884700801536:12345-0@lo:1000:mdt00_000.0 Request processed in 110us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075958.441496:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787075958.441601:0:5852:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1787075958.441606:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9961b94b8e00, transno 4294967303 00000100:00100000:0.0:1787075958.441627:0:5852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1873884700801536:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787075958.443322:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1787075958.443407:0:5852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1873884700801664:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787075958.443467:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075958.443499:0:5852:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191860c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787075958.443596:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700801664 00000100:00100000:2.0:1787075958.443606:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700801664 00000100:00100000:2.0:1787075958.443707:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787075958.443718:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1873884700801664:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787075958.444143:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1873884700801664:12345-0@lo:1000:mdt00_000.0 Request processed in 425us (673us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787075958.444154:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787075958.451219:0:5852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1873884700801664:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787075958.451280:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869fabb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.451294:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869fabb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.451303:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869fabb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.451311:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075958.451317:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869fabb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.451325:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869fabb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.451361:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996187c34e00) 00010000:00010000:0.0:1787075958.451365:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787075958.451371:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869fabb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.451379:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869fabb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.451432:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f9e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.451441:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f9e9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.451447:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f9e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.451453:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075958.451456:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f9e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.451464:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f9e9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.451473:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996191b79800) 00010000:00010000:0.0:1787075958.451475:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787075958.451478:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f9e9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.451486:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869f9e9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.451527:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869fac2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.451546:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fa05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234bf expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.451557:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869fac2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.451604:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fa05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234bf expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.451623:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fa05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234bf expref: 16 pid: 5852 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075958.451662:0:5852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961becb1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1873884700801792:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787075958.456444:0:5852:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191860c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787075958.467002:0:5852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961becb1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1873884700801792:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075958.467041:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869fac2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075958.475387:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075958.476025:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678760960 00000100:00100000:0.0:1787075958.476038:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678760960 00010000:00010000:0.0:1787075958.476083:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fa05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234bf expref: 17 pid: 5852 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075958.476127:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:0.0:1787075958.476138:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+17:2361:x1873884678760960:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075958.476167:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075958.476177:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fa05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234bf expref: 17 pid: 5852 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.476216:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fa05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234bf expref: 17 pid: 5852 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.476243:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fa05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234bf expref: 17 pid: 5852 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.476266:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996191b79800) 00010000:00010000:0.0:1787075958.476273:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869fac2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.476283:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869fac2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.476292:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869fac2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.476322:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075958.476383:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+16:2361:x1873884678760960:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 247us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075958.476391:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 46 00010000:00010000:0.0:1787075958.479939:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869fac2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.479962:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869fac2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.479977:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869fac2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.480000:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869fac2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.480009:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869fac2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.480016:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68e00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075958.480021:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869fac2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.480030:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869fac2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.480051:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996191b79800) 00010000:00010000:0.0:1787075958.480055:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075958.480061:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869fac2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.480068:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869fac2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.480085:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.480091:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fab4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.480097:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fab4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.480103:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075958.480112:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fab4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.480119:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fab4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.480128:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996191b79800) 00010000:00010000:0.0:1787075958.480131:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787075958.480134:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fab4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075958.480141:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869fab4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075958.480489:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+15:10441:x1873884678760704:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 50731us (50905us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787075958.480502:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 83 00000020:00080000:0.0:1787075958.480510:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787075958.480815:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787075958.480821:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787075958.480867:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787075958.480874:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787075958.489232:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075958.489317:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678761216 00000100:00100000:3.0:1787075958.489330:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678761216 00000100:00100000:3.0:1787075958.489393:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:3.0:1787075958.489405:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+15:10441:x1873884678761216:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787075958.490338:0:5855:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787075958.490460:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1787075958.490521:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fac9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.490540:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fac9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.490553:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fac9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.490562:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fac9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.490569:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fac9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.490576:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fac9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075958.490599:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787075958.490750:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+17:10441:x1873884678761216:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 1343us (1528us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787075958.490761:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00000020:00080000:3.0:1787075958.490767:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787075958.493329:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787075958.493345:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fac9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.493358:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523600 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787075958.493362:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fac9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.493373:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fac9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.493394:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff996194304000) 00010000:00010000:1.0:1787075958.493397:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787075958.493401:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fac9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.493408:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fac9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075958.493441:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075958.493444:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075958.493446:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075958.664270:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075959.688093:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787075960.445427:0:12061:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787075960.445439:0:12061:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787075960.445478:0:12061:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787075960.445483:0:12061:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1787075960.615565:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:0.0:1787075960.615590:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1787075960.646004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075960.647437:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678761472 00000100:00100000:2.0:1787075960.647454:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678761472 00000100:00100000:2.0:1787075960.647538:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:2.0:1787075960.647551:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+17:10460:x1873884678761472:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787075960.647580:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075960.647608:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fad0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76234f7 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787075960.648165:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787075960.650710:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869fad7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075960.650735:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869fad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075960.650755:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869fad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075960.650777:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787075960.654468:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fad0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234f7 expref: 20 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.654519:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869fad7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234f7 expref: 19 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.654530:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:3.0:1787075960.654533:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787075960.654538:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032000, rc 0) 00000100:00100000:3.0:1787075960.654663:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+19:10460:x1873884678761472:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 7092us (8647us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787075960.654673:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:3.0:1787075960.662194:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075960.662276:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678761600 00000100:00100000:1.0:1787075960.662286:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678761600 00000100:00100000:1.0:1787075960.662354:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:1.0:1787075960.662363:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+19:10460:x1873884678761600:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:1.0:1787075960.662461:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fae5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.662477:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fae5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.662489:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fae5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.662505:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869faec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.662512:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869faec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.662519:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869faec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.662880:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869faf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.662889:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869faf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.662895:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869faf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787075960.662935:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869faf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.662947:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fae5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.662963:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fae5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.662970:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fae5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.662976:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075960.662980:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fae5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.662987:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fae5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.662999:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:1.0:1787075960.663002:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075960.663007:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fae5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.663013:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fae5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.663027:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869faec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.663033:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869faec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.663039:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869faec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.663044:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075960.663054:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869faec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.663060:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869faec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.663067:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996187c34900) 00010000:00010000:1.0:1787075960.663069:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075960.663071:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869faec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.663077:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869faec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.663090:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869faf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.663096:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869faf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.663102:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869faf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.663107:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075960.663110:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869faf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.663129:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869faf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.663135:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996187c34200) 00010000:00010000:1.0:1787075960.663137:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075960.663144:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869faf3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.663150:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869faf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075960.663227:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+19:10460:x1873884678761600:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 863us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075960.663235:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 85 00010000:00010000:1.0:1787075960.713566:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075960.761523:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075960.761607:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678761856 00000100:00100000:3.0:1787075960.761618:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678761856 00000100:00100000:3.0:1787075960.761709:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 86 00000100:00100000:3.0:1787075960.761719:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+19:10463:x1873884678761856:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787075960.761740:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075960.761761:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869fafa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76234fe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.761845:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad6869fb01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.761860:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad6869fb01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.761871:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad6869fb01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.761904:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.761911:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.761917:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762386:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fb0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762398:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fb0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762406:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fb0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075960.762417:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787075960.762517:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad6869fb01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762524:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad6869fb01 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762531:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad6869fb01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762537:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075960.762541:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad6869fb01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762558:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad6869fb01 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762571:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:3.0:1787075960.762573:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075960.762577:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad6869fb01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762583:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad6869fb01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762596:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762601:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762607:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762612:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075960.762614:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762619:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762624:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996194304e00) 00010000:00010000:3.0:1787075960.762627:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075960.762629:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762668:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762720:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869fafa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234fe expref: 22 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762732:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fb0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234fe expref: 21 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.762738:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304800) 00010000:00010000:3.0:1787075960.762740:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787075960.762742:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523600, rc 0) 00000100:00100000:3.0:1787075960.763055:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+21:10463:x1873884678761856:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1335us (1543us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787075960.763066:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 86 00000100:00100000:3.0:1787075960.775456:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075960.775596:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678761984 00000100:00100000:1.0:1787075960.775607:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678761984 00000100:00100000:1.0:1787075960.775728:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 87 00000100:00100000:1.0:1787075960.775741:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+21:10463:x1873884678761984:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:1.0:1787075960.776006:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fb1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.776024:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fb1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.776036:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fb1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.776065:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fb1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.776073:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fb1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.776080:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fb1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.776104:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075960.776127:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fb1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.776136:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fb1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.776149:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304800) 00010000:00010000:1.0:1787075960.776152:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787075960.776157:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fb1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075960.776164:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fb1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075960.776288:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+21:10463:x1873884678761984:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 550us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075960.776297:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 87 00000100:00100000:3.0:1787075960.779374:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075960.779559:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678762240 00000100:00100000:1.0:1787075960.779570:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678762240 00000100:00100000:1.0:1787075960.779633:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:1.0:1787075960.779679:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b0114050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+21:10463:x1873884678762240:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1787075960.779947:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b0114050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+22:10463:x1873884678762240:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 270us (583us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787075960.779955:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:0.0:1787075960.860971:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075960.861082:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678762496 00000100:00100000:3.0:1787075960.861093:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678762496 00000100:00100000:3.0:1787075960.861176:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 88 00000100:00100000:3.0:1787075960.861191:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+22:9985:x1873884678762496:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787075960.861220:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075960.861247:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869fb24 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623505 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.861385:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.861414:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fb0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234fe expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.861425:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb2b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.861461:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fb0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234fe expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.861475:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fb0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234fe expref: 23 pid: 5853 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075960.861490:0:5853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1873884700801920:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787075960.861607:0:5853:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9c8c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787075960.865747:0:5853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1873884700801920:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787075960.865779:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075960.866715:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075960.867022:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678762624 00000100:00100000:2.0:1787075960.867034:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678762624 00010000:00010000:2.0:1787075960.867082:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fb0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234fe expref: 24 pid: 5853 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075960.867141:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:2.0:1787075960.867151:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+24:2359:x1873884678762624:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075960.867170:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075960.867178:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fb0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234fe expref: 24 pid: 5853 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075960.867192:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fb0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234fe expref: 24 pid: 5853 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075960.867218:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad6869fb0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234fe expref: 24 pid: 5853 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075960.867235:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304800) 00010000:00010000:2.0:1787075960.867268:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075960.867281:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075960.867289:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb2b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075960.867329:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075960.867480:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+23:2359:x1873884678762624:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 330us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075960.867489:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 47 00010000:00010000:0.0:1787075960.867703:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075960.867711:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075960.867745:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787075960.867964:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad6869fb24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623505 expref: 24 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075960.867983:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623505 expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075960.867990:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304800) 00010000:00010000:0.0:1787075960.867992:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787075960.867995:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523a00, rc 0) 00000100:00100000:0.0:1787075960.868024:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+23:9985:x1873884678762496:12345-192.168.204.50@tcp:101:bash.0 Request processed in 6836us (7065us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787075960.868031:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 88 00000100:00100000:3.0:1787075960.871492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075960.871753:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678762880 00000100:00100000:2.0:1787075960.871764:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678762880 00000100:00100000:2.0:1787075960.871828:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:2.0:1787075960.871838:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+23:9985:x1873884678762880:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:2.0:1787075960.872127:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075960.872145:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075960.872158:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787075960.872208:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1787075960.872229:0:5852:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000b83f2a62 reply state 00000000864102ba transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075960.872237:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787075960.872298:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1787075960.872420:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+27:9985:x1873884678762880:12345-192.168.204.50@tcp:36:bash.0 Request processed in 583us (938us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1787075960.872428:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 89 00000020:00080000:2.0:1787075960.872432:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787075960.883667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075960.883922:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678763008 00000100:00100000:0.0:1787075960.883932:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678763008 00000100:00100000:0.0:1787075960.884010:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 90 00000100:00100000:0.0:1787075960.884023:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+27:9985:x1873884678763008:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1787075960.884053:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075960.884079:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869fb40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762350c expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075960.884166:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869fb40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762350c expref: 28 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075960.884183:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869fb40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762350c expref: 28 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075960.884226:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304800) 00010000:00010000:0.0:1787075960.884229:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787075960.884232:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe69800, rc 0) 00000100:00100000:0.0:1787075960.884308:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+28:9985:x1873884678763008:12345-192.168.204.50@tcp:101:bash.0 Request processed in 288us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075960.884326:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 90 00010000:00010000:3.0:1787075960.885420:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.885438:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.885446:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.885453:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075960.885459:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.885468:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.885503:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304800) 00010000:00010000:3.0:1787075960.885507:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075960.885511:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.885518:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075960.889162:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075960.889339:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678763136 00000100:00100000:3.0:1787075960.889351:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678763136 00000100:00100000:3.0:1787075960.889431:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:3.0:1787075960.889442:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:9985:x1873884678763136:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787075960.889460:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075960.889482:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad6869fb47 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623513 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787075960.889513:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a849d75, atime: 0x6a849d73, ctime: 0x6a849d75, blocks: 0xb 00010000:00010000:3.0:1787075960.889538:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:3.0:1787075960.889544:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787075960.889554:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad6869fb47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623513 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.889574:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad6869fb47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623513 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075960.889591:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522800, rc 0) 00000100:00100000:3.0:1787075960.889694:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:9985:x1873884678763136:12345-192.168.204.50@tcp:101:bash.0 Request processed in 254us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075960.889715:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00080000:1.0:1787075960.890193:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787075960.902274:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075960.902451:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678763264 00000100:00100000:3.0:1787075960.902467:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678763264 00002000:00010000:3.0:1787075960.902519:0:6709:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1787075960.902525:0:6709:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961c1880a80 with x1873884678763264 ext(0->18446744073709551615) 00002000:00010000:3.0:1787075960.902539:0:6709:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9961c1880a80. 00000100:00100000:3.0:1787075960.902579:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:3.0:1787075960.902590:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2362:x1873884678763264:12345-192.168.204.50@tcp:10:bash.0 00002000:00010000:3.0:1787075960.902967:0:6709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787075960.902971:0:6709:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787075957 -> 1787075961 00002000:00010000:3.0:1787075960.902974:0:6709:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787075955 -> 1787075955 00002000:00010000:3.0:1787075960.902976:0:6709:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787075957 -> 1787075961 00002000:00010000:3.0:1787075960.902978:0:6709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787075960.903032:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2362:x1873884678763264:12345-192.168.204.50@tcp:10:bash.0 Request processed in 444us (787us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787075960.903040:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00002000:00010000:3.0:1787075960.903044:0:6709:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1787075960.903046:0:6709:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961c1880a80 with x1873884678763264 ext(0->18446744073709551615) 00002000:00010000:3.0:1787075960.903050:0:6709:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9961c1880a80. 00000100:00100000:0.0:1787075961.033699:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075961.033930:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678763392 00000100:00100000:2.0:1787075961.033943:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678763392 00000100:00100000:2.0:1787075961.034027:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 91 00000100:00100000:2.0:1787075961.034040:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+27:10477:x1873884678763392:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:2.0:1787075961.034155:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.034176:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.034195:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.034213:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fb55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.034222:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fb55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.034230:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fb55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.034592:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fb5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.034603:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fb5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.034621:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fb5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787075961.034692:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fb5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.034703:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.034709:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.034716:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.034722:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075961.034727:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.034733:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.034745:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:2.0:1787075961.034748:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075961.034752:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.034759:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fb4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.034773:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fb55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.035929:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fb55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.035948:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fb55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.035954:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075961.035959:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fb55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.035968:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fb55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.035985:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996191b79f00) 00010000:00010000:2.0:1787075961.035988:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075961.035991:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fb55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.035998:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fb55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.036023:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fb5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.036030:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fb5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.036036:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fb5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.036042:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075961.036057:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fb5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.036064:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fb5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.036072:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304800) 00010000:00010000:2.0:1787075961.036075:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075961.036078:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fb5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.036084:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fb5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075961.036226:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+27:10477:x1873884678763392:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 2183us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075961.036240:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 91 00000100:00100000:0.0:1787075961.088216:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075961.089997:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678763648 00000100:00100000:3.0:1787075961.090015:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678763648 00000100:00100000:3.0:1787075961.090263:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 92 00000100:00100000:3.0:1787075961.090276:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+27:10480:x1873884678763648:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787075961.090307:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075961.090335:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fb63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762351a expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.090440:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fb6a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.090455:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fb6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.090467:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fb6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.090483:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fb71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.090491:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fb71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.090498:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fb71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.090897:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869fb78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.090908:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869fb78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.090916:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869fb78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075961.090927:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787075961.091027:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fb6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.091035:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fb6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.091049:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fb6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.091054:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075961.091058:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fb6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.091066:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fb6a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.091081:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:3.0:1787075961.091085:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075961.091091:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fb6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.091098:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fb6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.091131:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fb71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.091137:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fb71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.091143:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fb71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.091148:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075961.091151:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fb71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.091168:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fb71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.091177:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996194304d00) 00010000:00010000:3.0:1787075961.091180:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075961.091183:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fb71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.091189:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fb71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.091243:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fb63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762351a expref: 30 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.091257:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869fb78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762351a expref: 29 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.091265:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304800) 00010000:00010000:3.0:1787075961.091267:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787075961.091270:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522200, rc 0) 00000100:00100000:3.0:1787075961.091341:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+29:10480:x1873884678763648:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1068us (3141us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1787075961.091351:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 92 00000100:00100000:2.0:1787075961.097483:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075961.101887:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678763776 00000100:00100000:1.0:1787075961.101921:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678763776 00000100:00100000:1.0:1787075961.102048:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 93 00000100:00100000:1.0:1787075961.102060:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+29:10480:x1873884678763776:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:1.0:1787075961.102721:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fb86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.102743:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb2b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623505 expref: 29 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.102753:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fb86 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.102804:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623505 expref: 29 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.102819:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623505 expref: 29 pid: 5853 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075961.102833:0:5854:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1873884700802048:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787075961.102939:0:5854:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787075961.106590:0:5854:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1873884700802048:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787075961.106625:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fb86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075961.107339:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075961.108024:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678764032 00000100:00100000:1.0:1787075961.108039:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678764032 00000100:00100000:1.0:1787075961.108225:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:1.0:1787075961.108237:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+30:5600:x1873884678764032:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787075961.108605:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+31:5600:x1873884678764032:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 371us (1271us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787075961.108614:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:0.0:1787075961.112234:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075961.112582:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678764160 00000100:00100000:1.0:1787075961.112596:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678764160 00010000:00010000:1.0:1787075961.112684:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623505 expref: 31 pid: 5853 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075961.113072:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:3.0:1787075961.113086:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+31:2361:x1873884678764160:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787075961.113103:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075961.113556:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623505 expref: 31 pid: 5853 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.113590:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623505 expref: 31 pid: 5853 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.113616:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fb2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623505 expref: 31 pid: 5853 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.113635:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304800) 00010000:00010000:3.0:1787075961.113680:0:8465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fb86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.113691:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fb86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.113699:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fb86 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.113741:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075961.113825:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+30:2361:x1873884678764160:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 742us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075961.113834:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 48 00010000:00010000:2.0:1787075961.113993:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fb86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.114003:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fb86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.114037:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fb86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.114045:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fb86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.114053:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fb86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.114069:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075961.114075:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fb86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.114084:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fb86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.114094:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304800) 00010000:00010000:2.0:1787075961.114097:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787075961.114102:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fb86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.114128:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fb86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075961.114174:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+29:10480:x1873884678763776:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 12117us (16704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075961.114183:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 93 00000100:00100000:0.0:1787075961.118097:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075961.124436:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678764416 00000100:00100000:1.0:1787075961.124453:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678764416 00000100:00100000:1.0:1787075961.124626:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:1.0:1787075961.124661:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+29:10480:x1873884678764416:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1787075961.124983:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+30:10480:x1873884678764416:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 347us (6896us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787075961.124993:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:0.0:1787075961.341073:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075961.341365:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678764672 00000100:00100000:1.0:1787075961.341376:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678764672 00000100:00100000:1.0:1787075961.341508:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 94 00000100:00100000:1.0:1787075961.341520:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+30:10491:x1873884678764672:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1787075961.341552:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075961.341584:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869fb8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623521 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.341697:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fb94 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.341712:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fb94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.341745:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fb94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.341768:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad6869fb9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.341788:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad6869fb9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.341796:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad6869fb9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.342217:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869fba2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.342241:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869fba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.342249:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869fba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075961.342259:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787075961.342814:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fb94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.342961:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fb94 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.342969:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fb94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.342975:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075961.342988:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fb94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.343001:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fb94 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.343022:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:1.0:1787075961.343025:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075961.343032:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fb94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.343039:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fb94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.343055:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad6869fb9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.343062:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad6869fb9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.343069:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad6869fb9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.343074:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075961.343076:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad6869fb9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.343082:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad6869fb9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.343088:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996187c34200) 00010000:00010000:1.0:1787075961.343090:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075961.343097:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad6869fb9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.343115:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad6869fb9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.343183:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869fb8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623521 expref: 33 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.343198:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869fba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623521 expref: 32 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.343205:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304800) 00010000:00010000:1.0:1787075961.343208:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787075961.343210:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632e00, rc 0) 00000100:00100000:1.0:1787075961.343290:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+32:10491:x1873884678764672:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1771us (2227us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787075961.344321:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 94 00000100:00100000:3.0:1787075961.349126:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075961.349346:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678764928 00000100:00100000:2.0:1787075961.349356:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678764928 00000100:00100000:2.0:1787075961.349417:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:2.0:1787075961.349427:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+32:10491:x1873884678764928:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1787075961.350089:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+33:10491:x1873884678764928:12345-192.168.204.50@tcp:35:cat.0 Request processed in 661us (989us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787075961.350108:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:0.0:1787075961.388708:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075961.388816:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678765184 00000100:00100000:2.0:1787075961.388837:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678765184 00000100:00100000:2.0:1787075961.388901:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 95 00000100:00100000:2.0:1787075961.388928:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+33:10492:x1873884678765184:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:2.0:1787075961.388994:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787075961.389024:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869fba2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623521 expref: 33 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.389050:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad6869fb78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762351a expref: 32 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.389064:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869fb40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762350c expref: 31 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.389074:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996194304800) 00010000:00010000:2.0:1787075961.389114:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787075961.389147:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fbb0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.389164:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fbb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.389175:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fbb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.389191:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fbb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.389198:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fbb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.389205:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fbb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.390025:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fbbe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.390038:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fbbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.390047:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fbbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787075961.392032:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1787075961.392046:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343367405952ns, next at 344367402987ns, rc = 0 00010000:00010000:2.0:1787075961.392353:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fbc5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392371:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fbc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392384:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fbc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392392:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fbc5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392399:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fbc5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392405:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fbc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392487:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787075961.392514:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fbbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392531:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fbbe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392538:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fbbe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392544:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075961.392549:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fbbe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392557:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fbbe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392571:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996191b79900) 00010000:00010000:2.0:1787075961.392573:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787075961.392578:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fbbe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392585:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fbbe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392607:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fbb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392613:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fbb0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392620:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fbb0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392625:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075961.392633:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fbb0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392662:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fbb0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392671:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:2.0:1787075961.392673:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075961.392676:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fbb0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.392683:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fbb0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787075961.392694:0:5852:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000c3200915 reply state 0000000034e0cb7d transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fbb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075961.392704:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787075961.393084:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+32:10492:x1873884678765184:12345-192.168.204.50@tcp:36:rm.0 Request processed in 4152us (4381us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787075961.393094:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 95 00010000:00010000:1.0:1787075961.397769:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787075961.397793:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fbc5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.397807:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032400 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787075961.397812:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fbc5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.398067:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fbc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.398090:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff996191b79900) 00010000:00010000:1.0:1787075961.398122:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787075961.398138:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fbc5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.398146:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fbc5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.398188:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075961.398191:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075961.398193:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075961.402961:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fbb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.402981:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fbb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.402988:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fbb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.402995:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075961.403000:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fbb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.403026:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fbb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.403046:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996191b79f00) 00010000:00010000:2.0:1787075961.403049:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075961.403055:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fbb7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.403062:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fbb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075961.476770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075961.476999:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678765440 00000100:00100000:3.0:1787075961.477009:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678765440 00000100:00100000:3.0:1787075961.477087:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 96 00000100:00100000:3.0:1787075961.477109:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+31:10498:x1873884678765440:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787075961.477148:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075961.477173:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fbcc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623528 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.477357:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fbd3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.477372:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fbd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.477383:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fbd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.477398:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fbda lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.477404:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fbda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.477409:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fbda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787075961.478035:0:7654:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787075961.478227:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fbe1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.478239:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.478248:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.478284:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fbd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.478306:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fbd3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.478313:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fbd3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.478319:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075961.478323:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fbd3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.478331:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fbd3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.478343:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:3.0:1787075961.478346:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075961.478350:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fbd3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.478355:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fbd3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787075961.478369:0:7654:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000657f48fb reply state 000000007632a6b5 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fbda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075961.478378:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787075961.478409:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fbcc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623528 expref: 34 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.478423:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fbe1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623528 expref: 33 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.478442:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996194304700) 00010000:00010000:3.0:1787075961.478444:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787075961.478447:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522a00, rc 0) 00000100:00100000:3.0:1787075961.478534:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+34:10498:x1873884678765440:12345-192.168.204.50@tcp:101:bash.0 Request processed in 1437us (1777us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787075961.478545:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 96 00010000:00010000:3.0:1787075961.483537:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fbda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.483557:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fbda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.483565:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fbda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.483572:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075961.483577:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fbda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.483585:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fbda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.483605:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996194304d00) 00010000:00010000:3.0:1787075961.483608:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075961.483613:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fbda lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.483619:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fbda lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075961.485279:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075961.487117:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678765568 00000100:00100000:3.0:1787075961.487140:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678765568 00000100:00100000:3.0:1787075961.487270:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:3.0:1787075961.487285:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2359:x1873884678765568:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787075961.487312:0:8477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075961.487340:0:8477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f32696a7/0x859911ad6869fbef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762352f expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787075961.487373:0:8477:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787075961.487396:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1787075961.487403:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787075961.487415:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f32696a7/0x859911ad6869fbef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762352f expref: 6 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.487438:0:8477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f32696a7/0x859911ad6869fbef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762352f expref: 6 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.487453:0:8477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523000, rc 0) 00000100:00100000:3.0:1787075961.487537:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678765568:12345-192.168.204.50@tcp:101:bash.0 Request processed in 255us (2270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075961.487544:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00080000:1.0:1787075961.488017:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787075961.493422:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075961.497594:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678765696 00000100:00100000:1.0:1787075961.497610:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678765696 00000100:00100000:1.0:1787075961.497729:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:1.0:1787075961.497740:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:10498:x1873884678765696:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1787075961.497762:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075961.497783:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad6869fbf6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623536 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.497818:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f32696a7/0x859911ad6869fbef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762352f expref: 7 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.497828:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787075961.497834:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787075961.497840:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad6869fbf6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623536 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.497882:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f32696a7/0x859911ad6869fbef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762352f expref: 7 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.497918:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f32696a7/0x859911ad6869fbef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762352f expref: 7 pid: 8477 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075961.497935:0:6706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1873884700802176:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787075961.498061:0:6706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616540 going to sleep for 11 seconds 00000100:00100000:1.0:1787075961.502663:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1873884700802176:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787075961.502704:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad6869fbf6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623536 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.502725:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632600, rc 0) 00000100:00100000:1.0:1787075961.502829:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:10498:x1873884678765696:12345-192.168.204.50@tcp:101:bash.0 Request processed in 5089us (9418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075961.502841:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:2.0:1787075961.503019:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075961.503203:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678765824 00000100:00100000:3.0:1787075961.503219:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678765824 00010000:00010000:3.0:1787075961.503429:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f32696a7/0x859911ad6869fbef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762352f expref: 7 pid: 8477 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075961.503503:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:3.0:1787075961.503515:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a03c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2362:x1873884678765824:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787075961.503533:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075961.503565:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f32696a7/0x859911ad6869fbef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762352f expref: 7 pid: 8477 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.503581:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f32696a7/0x859911ad6869fbef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762352f expref: 7 pid: 8477 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.503611:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f32696a7/0x859911ad6869fbef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762352f expref: 7 pid: 8477 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.503629:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787075961.503634:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787075961.503897:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad6869fbf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623536 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.503912:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad6869fbf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623536 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.503963:0:5838:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad6869fbf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623536 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075961.503980:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5838:1873884700802304:192.168.204.50@tcp:105: 00000100:00100000:3.0:1787075961.504110:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9c8c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787075961.518981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075961.519253:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5838:1873884700802304:192.168.204.50@tcp:105: 00010000:00010000:3.0:1787075961.519284:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075961.519355:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a03c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2362:x1873884678765824:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 15841us (16335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075961.519368:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:1.0:1787075961.519897:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678766080 00000100:00100000:1.0:1787075961.519908:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678766080 00000100:00100000:1.0:1787075961.519963:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:1.0:1787075961.519975:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+33:10498:x1873884678766080:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:1.0:1787075961.521083:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+34:10498:x1873884678766080:12345-192.168.204.50@tcp:35:bash.0 Request processed in 1101us (2108us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1787075961.521094:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:0.0:1787075961.545011:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700802816:0@lo:400:kworker.0 00000100:00100000:0.0:1787075961.545112:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075961.545163:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787075961.545170:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf77bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873884700802688:0@lo:400:kworker.0 00000100:00100000:0.0:1787075961.545200:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075961.545232:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700802816 00000100:00100000:1.0:1787075961.545538:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf77aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700802560:0@lo:400:kworker.0 00000100:00100000:1.0:1787075961.545572:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075961.545596:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700803072:0@lo:400:kworker.0 00000100:00100000:1.0:1787075961.545633:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075961.545679:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787075961.545685:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700802432:0@lo:400:kworker.0 00000100:00100000:1.0:1787075961.545712:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075961.545738:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf77a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700802944:0@lo:400:kworker.0 00000100:00100000:1.0:1787075961.545759:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075961.545791:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700802432 00000100:00100000:1.0:1787075961.545798:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700802432 00000100:00100000:1.0:1787075961.545870:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787075961.545879:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3312:x1873884700802432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075961.545931:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3312:x1873884700802432:12345-0@lo:400:kworker.0 Request processed in 54us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075961.545937:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787075961.545981:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700802432:0@lo:400:kworker.0 00000100:00100000:1.0:1787075961.546003:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700802688 00000100:00100000:1.0:1787075961.546006:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700802688 00000100:00100000:1.0:1787075961.546039:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700802560 00000100:00100000:1.0:1787075961.546041:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700802560 00000100:00100000:1.0:1787075961.546051:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700802944 00000100:00100000:1.0:1787075961.546052:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700802944 00000100:00100000:1.0:1787075961.546065:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787075961.546071:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873884700802688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075961.546124:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1873884700802688:12345-0@lo:400:kworker.0 Request processed in 53us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075961.546132:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787075961.546143:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787075961.546149:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700802560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075961.546187:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700802560:12345-0@lo:400:kworker.0 Request processed in 39us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075961.546193:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787075961.546205:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787075961.546212:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700802944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075961.546237:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700802944:12345-0@lo:400:kworker.0 Request processed in 26us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075961.546449:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700803072 00000100:00100000:2.0:1787075961.546453:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700803072 00000100:00100000:2.0:1787075961.546485:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787075961.546494:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1873884700803072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075961.546530:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1873884700803072:12345-0@lo:400:kworker.0 Request processed in 39us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075961.546536:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787075961.546754:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700803200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787075961.546793:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075961.546836:0:9220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700803200 00000100:00100000:2.0:1787075961.546840:0:9220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700803200 00000100:00100000:2.0:1787075961.546874:0:9220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787075961.546882:0:9220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1873884700803200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787075961.546922:0:9220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075961.546964:0:9220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1873884700803200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075961.546980:0:9220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787075961.547025:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700803200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075961.547293:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1787075961.547315:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787075961.547320:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075961.547345:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf77bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873884700802688:0@lo:400:kworker.0 00000100:00100000:1.0:1787075961.547371:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf77a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700802944:0@lo:400:kworker.0 00000100:00100000:1.0:1787075961.547381:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf77aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700802560:0@lo:400:kworker.0 00000100:00100000:1.0:1787075961.547389:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700803072:0@lo:400:kworker.0 00000100:00100000:0.0:1787075961.547477:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700802816 00000100:00100000:0.0:1787075961.547533:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787075961.547540:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700802816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075961.547590:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700802816:12345-0@lo:400:kworker.0 Request processed in 50us (2479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075961.547596:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1787075961.548415:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787075961.548452:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1787075961.548460:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1787075961.548488:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9961b94b8000, transno 4294967301 00000100:00100000:1.0:1787075961.548503:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700802816:0@lo:400:kworker.0 00000100:00100000:0.0:1787075961.715409:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075961.715525:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678766208 00000100:00100000:2.0:1787075961.715535:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678766208 00000100:00100000:2.0:1787075961.715607:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 97 00000100:00100000:2.0:1787075961.715619:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+34:10514:x1873884678766208:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787075961.715687:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075961.715711:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fbfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762353d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.715780:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fc04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.715795:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fc04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.715807:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fc04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075961.716077:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787075961.716082:0:5852:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787075961.716121:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fc04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.716152:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fbfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762353d expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.716173:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fc04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762353d expref: 35 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.717112:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:2.0:1787075961.717116:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787075961.717120:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032c00, rc 0) 00000100:00100000:2.0:1787075961.717216:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+35:10514:x1873884678766208:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1596us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075961.717226:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 97 00000100:00100000:0.0:1787075961.723524:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075961.729885:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678766464 00000100:00100000:1.0:1787075961.729912:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678766464 00000100:00100000:1.0:1787075961.730040:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 98 00000100:00100000:1.0:1787075961.730057:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+35:10514:x1873884678766464:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787075961.730112:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075961.730237:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fc0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623544 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.730679:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fc12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.730989:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fc12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.731008:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fc12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075961.731025:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787075961.735467:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fc0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623544 expref: 38 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.735511:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fc12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623544 expref: 37 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.735522:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996194304700) 00010000:00010000:1.0:1787075961.735526:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787075961.735531:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632000, rc 0) 00000100:00100000:1.0:1787075961.735799:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+37:10514:x1873884678766464:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 5743us (12290us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787075961.735814:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 98 00010000:00010000:1.0:1787075961.737914:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075961.747951:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075961.748119:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075961.748309:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678766848 00000100:00100000:2.0:1787075961.748331:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678766848 00000100:00100000:2.0:1787075961.748440:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:2.0:1787075961.748457:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf779f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+37:2362:x1873884678766848:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075961.748478:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787075961.748509:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678766720 00010000:00010000:2.0:1787075961.748513:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fc12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623544 expref: 37 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075961.748520:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678766720 00010000:00010000:2.0:1787075961.748546:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996194304700) 00010000:00010000:2.0:1787075961.748553:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075961.748630:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf779f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+37:2362:x1873884678766848:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 179us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075961.748696:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:2.0:1787075961.750843:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 99 00000100:00100000:2.0:1787075961.750944:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+36:10514:x1873884678766720:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787075961.750974:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075961.750995:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fc20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762354b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.751134:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fc27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.751150:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fc27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.751163:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fc27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075961.751470:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787075961.751622:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fc20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762354b expref: 39 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.751685:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fc27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762354b expref: 38 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.751695:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996194304700) 00010000:00010000:2.0:1787075961.751699:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787075961.751702:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9033400, rc 0) 00000100:00100000:2.0:1787075961.751779:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+38:10514:x1873884678766720:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 921us (3846us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787075961.751787:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 99 00000100:00100000:0.0:1787075961.779153:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075961.779895:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678766976 00000100:00100000:2.0:1787075961.779914:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678766976 00000100:00100000:2.0:1787075961.780013:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:2.0:1787075961.780024:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2362:x1873884678766976:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:2.0:1787075961.780088:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004be8e94f/0x859911ad6869fc35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.780213:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad6869fbf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623536 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.780223:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787075961.780229:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787075961.780234:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004be8e94f/0x859911ad6869fc35 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.780300:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad6869fbf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623536 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075961.780321:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad6869fbf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623536 expref: 6 pid: 6706 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075961.780344:0:6704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1873884700803328:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787075961.780589:0:6704:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187638780 going to sleep for 11 seconds 00000100:00100000:3.0:1787075961.794746:0:6704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e07480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1873884700803328:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075961.794800:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004be8e94f/0x859911ad6869fc35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075961.813341:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075961.814069:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678767104 00000100:00100000:1.0:1787075961.814084:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678767104 00002000:00100000:1.0:1787075961.814186:0:6710:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9961bf77a680 x1873884678767104/t0(0) o4->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:32/0 lens 504/0 e 0 to 0 dl 1787075972 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787075961.814199:0:6710:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961bf77a680 with x1873884678767104 ext(0->8) 00010000:00010000:1.0:1787075961.814212:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad6869fbf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623536 expref: 7 pid: 6706 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.814234:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad6869fbf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623536 expref: 7 pid: 6706 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787075961.814244:0:6710:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9961bf77a680 00000100:00100000:1.0:1787075961.814338:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:1.0:1787075961.814352:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2362:x1873884678767104:12345-192.168.204.50@tcp:4:lfs.0 00000100:00100000:1.0:1787075961.815470:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:2362:x1873884678767104:12345-192.168.204.50@tcp:4:lfs.0 Request processed in 1113us (2139us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787075961.815482:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00002000:00100000:1.0:1787075961.815491:0:6710:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9961bf77a680 x1873884678767104/t4294967302(0) o4->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:32/0 lens 504/448 e 0 to 0 dl 1787075972 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787075961.815502:0:6710:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961bf77a680 with x1873884678767104 ext(0->8) 00010000:00010000:1.0:1787075961.815513:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad6869fbf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623536 expref: 9 pid: 6706 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.815535:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad6869fbf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623536 expref: 9 pid: 6706 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787075961.815544:0:6710:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9961bf77a680 00000100:00100000:3.0:1787075961.820806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075961.820950:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678767232 00000100:00100000:0.0:1787075961.820963:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678767232 00010000:00010000:0.0:1787075961.821036:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad6869fbf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623536 expref: 9 pid: 6706 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075961.821102:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:0.0:1787075961.821116:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:2359:x1873884678767232:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075961.821138:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787075961.821167:0:5837:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787075961.821171:0:5837:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787075961 00002000:00010000:0.0:1787075961.821174:0:5837:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787075962 00002000:00010000:0.0:1787075961.821178:0:5837:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787075961 00010000:00010000:0.0:1787075961.821186:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad6869fbf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623536 expref: 9 pid: 6706 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075961.821207:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad6869fbf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623536 expref: 9 pid: 6706 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075961.821271:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad6869fbf6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623536 expref: 9 pid: 6706 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075961.821296:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787075961.821302:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787075961.821310:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004be8e94f/0x859911ad6869fc35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075961.821323:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004be8e94f/0x859911ad6869fc35 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075961.821369:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787075961.821401:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004be8e94f/0x859911ad6869fc35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.821415:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004be8e94f/0x859911ad6869fc35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.821454:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004be8e94f/0x859911ad6869fc35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.821464:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004be8e94f/0x859911ad6869fc35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075961.821467:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2359:x1873884678767232:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 352us (688us total) trans 0 rc 0/0 00010000:00010000:3.0:1787075961.821482:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004be8e94f/0x859911ad6869fc35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075961.821485:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 50 00010000:00010000:3.0:1787075961.821510:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032800 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787075961.821517:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004be8e94f/0x859911ad6869fc35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.821529:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004be8e94f/0x859911ad6869fc35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.821543:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004be8e94f/0x859911ad6869fc35 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.821552:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004be8e94f/0x859911ad6869fc35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075961.821705:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2362:x1873884678766976:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 41617us (42498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075961.821715:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:2.0:1787075961.828999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075961.829397:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678767488 00000100:00100000:1.0:1787075961.829416:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678767488 00000100:00100000:1.0:1787075961.829507:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:1.0:1787075961.829520:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b0115c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+38:10514:x1873884678767488:12345-192.168.204.50@tcp:35:lfs.0 00000004:00010000:1.0:1787075961.829629:0:5855:0:(mdt_open.c:1970:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fc27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762354b expref: 38 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787075961.830926:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1787075961.830996:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1787075961.831447:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1787075961.831518:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fc3c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.831558:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fbe1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623528 expref: 42 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.831569:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fc3c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.831624:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fbe1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623528 expref: 42 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.831678:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fbe1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623528 expref: 42 pid: 7654 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075961.831698:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf656a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1873884700803456:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787075961.831836:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616780 going to sleep for 11 seconds 00000100:00100000:0.0:1787075961.836514:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075961.836863:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678767616 00000100:00100000:3.0:1787075961.836876:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678767616 00010000:00010000:0.0:1787075961.837064:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fbe1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623528 expref: 43 pid: 7654 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075961.837131:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:0.0:1787075961.837149:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+43:2361:x1873884678767616:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075961.837170:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075961.837179:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fbe1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623528 expref: 43 pid: 7654 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075961.837225:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fbe1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623528 expref: 43 pid: 7654 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075961.837264:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996194304700) 00010000:00010000:0.0:1787075961.837272:0:8465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fc3c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075961.837286:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fc3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075961.837296:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fc3c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075961.837326:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075961.837537:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+43:2361:x1873884678767616:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 369us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075961.837559:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 51 00010000:00010000:1.0:1787075961.838548:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad6869fbe1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623528 expref: 42 pid: 7654 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075961.838605:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf656a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1873884700803456:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787075961.838694:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fc3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.838829:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fc3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.838836:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fc3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787075961.839022:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787075961.839471:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787075961.840118:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf656a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1873884700803584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787075961.840928:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075961.840985:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff996189361240 going to sleep for 11 seconds 00000100:00100000:2.0:1787075961.841441:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700803584 00000100:00100000:2.0:1787075961.841460:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700803584 00000100:00100000:2.0:1787075961.841550:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787075961.841563:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5855:x1873884700803584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787075961.842186:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5855:x1873884700803584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 623us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075961.842197:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787075961.842331:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf656a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1873884700803584:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787075961.843396:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787075961.843525:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94b8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1873884700803712:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787075961.843769:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075961.843883:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616780 going to sleep for 11 seconds 00000100:00100000:2.0:1787075961.843932:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700803712 00000100:00100000:2.0:1787075961.843949:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700803712 00000100:00100000:2.0:1787075961.844073:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787075961.844085:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1873884700803712:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787075961.844396:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1873884700803712:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 314us (628us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787075961.844405:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787075961.844497:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94b8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1873884700803712:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787075961.844581:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1787075961.844682:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fc3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.844695:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fc3c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.844722:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fc3c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.844730:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075961.844738:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fc3c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.844749:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fc3c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.844770:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996194304700) 00010000:00010000:1.0:1787075961.844774:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787075961.844780:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fc3c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.844789:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fc3c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787075961.845055:0:5855:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787075961.845204:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1787075961.845220:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343820579679ns, next at 344820576669ns, rc = 0 00000001:00080000:1.0:1787075961.845228:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1787075961.845283:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996194304700) 00010000:00010000:1.0:1787075961.845287:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787075961.845298:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fc27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762354b expref: 46 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075961.845486:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b0115c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+45:10514:x1873884678767488:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 15967us (16501us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1787075961.845510:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 26 00000020:00080000:1.0:1787075961.845516:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787075961.850340:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075961.850809:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678767744 00000100:00100000:1.0:1787075961.850825:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678767744 00000100:00100000:1.0:1787075961.851030:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 100 00000100:00100000:1.0:1787075961.851045:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+45:10514:x1873884678767744:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787075961.851087:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075961.851138:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad6869fc43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623552 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.851233:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad6869fc43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623552 expref: 46 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.851251:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad6869fc43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623552 expref: 46 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075961.851275:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:1.0:1787075961.851279:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787075961.851284:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf633200, rc 0) 00000100:00100000:1.0:1787075961.851390:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+46:10514:x1873884678767744:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 348us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075961.851400:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 100 00000100:00100000:1.0:1787075961.865750:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075961.865938:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678768000 00000100:00100000:2.0:1787075961.865953:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678768000 00000100:00100000:2.0:1787075961.866039:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:2.0:1787075961.866055:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+46:10514:x1873884678768000:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1787075961.866461:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+47:10514:x1873884678768000:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 408us (726us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787075961.866471:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:2.0:1787075961.991373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075961.994618:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678768128 00000100:00100000:3.0:1787075961.994655:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678768128 00000100:00100000:3.0:1787075961.995227:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 101 00000100:00100000:3.0:1787075961.995258:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+47:10524:x1873884678768128:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:3.0:1787075961.995410:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc4a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995435:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995477:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995498:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995507:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995515:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995721:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fc58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995732:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fc58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995739:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fc58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787075961.995819:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fc58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995835:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995843:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc4a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995851:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995872:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075961.995887:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995897:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc4a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995913:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:3.0:1787075961.995917:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075961.995922:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995930:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995950:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995956:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995962:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995968:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075961.995971:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995977:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.995997:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996194304f00) 00010000:00010000:3.0:1787075961.995999:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075961.996003:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.996009:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.996056:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fc58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.996063:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fc58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.996070:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fc58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.996080:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075961.996083:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fc58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.996099:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fc58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.996107:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:3.0:1787075961.996110:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075961.996113:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fc58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075961.996119:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fc58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075961.996247:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+47:10524:x1873884678768128:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 995us (4892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075962.002416:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 101 00000100:00100000:0.0:1787075962.048338:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075962.048594:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678768384 00000100:00100000:3.0:1787075962.048608:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678768384 00000100:00080000:1.0:1787075962.048833:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075962.049054:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 102 00000100:00100000:3.0:1787075962.049071:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+47:10527:x1873884678768384:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787075962.049122:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075962.049161:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fc5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623559 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.049469:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.049490:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.049507:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.049525:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.049531:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.049539:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.049813:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869fc74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.049823:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869fc74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.049831:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869fc74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075962.049845:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787075962.050826:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.050848:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc66 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.050857:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.050863:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075962.050868:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.051288:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc66 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.051311:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:3.0:1787075962.051315:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075962.051321:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.051460:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fc66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.051484:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.051490:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.051496:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.051501:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075962.051505:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.051512:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.051521:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996194304f00) 00010000:00010000:3.0:1787075962.051524:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075962.051527:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.051533:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fc6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.051632:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fc5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623559 expref: 50 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.051715:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869fc74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623559 expref: 49 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.051731:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:3.0:1787075962.051734:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787075962.051737:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523400, rc 0) 00000100:00100000:3.0:1787075962.051855:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+49:10527:x1873884678768384:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2787us (3529us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787075962.051869:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 102 00000100:00100000:1.0:1787075962.058113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.058369:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678768512 00000100:00100000:2.0:1787075962.058384:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678768512 00000100:00100000:2.0:1787075962.058477:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 103 00000100:00100000:2.0:1787075962.058490:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+49:10527:x1873884678768512:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:2.0:1787075962.058612:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.058690:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.058709:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.058768:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.058788:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.058798:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.058807:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075962.058812:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.058821:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.058839:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:2.0:1787075962.058842:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787075962.058849:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.058857:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075962.058981:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+49:10527:x1873884678768512:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 494us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075962.058991:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 103 00000100:00100000:0.0:1787075962.065156:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.065543:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678768768 00000100:00100000:2.0:1787075962.065558:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678768768 00000100:00100000:2.0:1787075962.065662:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:2.0:1787075962.065708:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+49:10527:x1873884678768768:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1787075962.066606:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+50:10527:x1873884678768768:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 908us (1466us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787075962.066617:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:0.0:1787075962.163134:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075962.163192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075962.163245:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075962.163330:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075962.163383:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678769280 00000100:00100000:0.0:1787075962.163396:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678769280 00000100:00080000:0.0:1787075962.163443:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787075962.163512:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 133 00000100:00100000:0.0:1787075962.163527:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2361:x1873884678769280:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075962.163721:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2361:x1873884678769280:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 197us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075962.163730:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 133 00000100:00100000:3.0:1787075962.164102:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678768896 00000100:00100000:3.0:1787075962.164111:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678768896 00000100:00100000:3.0:1787075962.164160:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 284 00000100:00100000:3.0:1787075962.164168:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2361:x1873884678768896:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075962.164208:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2361:x1873884678768896:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 42us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075962.164220:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 284 00000100:00100000:2.0:1787075962.167824:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678769152 00000100:00100000:2.0:1787075962.167858:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678769152 00000100:00100000:2.0:1787075962.168018:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678769024 00000100:00100000:2.0:1787075962.168023:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678769024 00000100:00080000:0.0:1787075962.168118:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787075962.168165:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:2.0:1787075962.168195:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2361:x1873884678769152:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075962.168368:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2361:x1873884678769152:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 177us (5174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075962.175722:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:3.0:1787075962.175765:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2361:x1873884678769024:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075962.175897:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2361:x1873884678769024:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 157us (12652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075962.175907:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:2.0:1787075962.179735:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:0.0:1787075962.192532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.194288:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678769536 00000100:00100000:2.0:1787075962.194318:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678769536 00000100:00100000:2.0:1787075962.194569:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 104 00000100:00100000:2.0:1787075962.194584:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+50:10537:x1873884678769536:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1787075962.194623:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075962.194628:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787075962.194723:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fc04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762353d expref: 50 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.194750:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:2.0:1787075962.194755:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787075962.194772:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc89 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623560 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.194938:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fc90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.194955:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fc90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.194968:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fc90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075962.194982:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787075962.195179:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc89 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623560 expref: 52 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.195197:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fc90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623560 expref: 51 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.195206:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:2.0:1787075962.195210:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787075962.195213:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032800, rc 0) 00000100:00100000:2.0:1787075962.195316:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+51:10537:x1873884678769536:12345-192.168.204.50@tcp:101:bash.0 Request processed in 735us (2803us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787075962.195326:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 104 00000100:00100000:3.0:1787075962.197834:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.197924:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678769664 00000100:00100000:2.0:1787075962.197937:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678769664 00000100:00100000:2.0:1787075962.198027:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:2.0:1787075962.198040:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+51:2361:x1873884678769664:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075962.198067:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075962.198130:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fc90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623560 expref: 51 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.198159:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:2.0:1787075962.198165:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075962.198257:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+50:2361:x1873884678769664:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 220us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075962.198267:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:0.0:1787075962.199303:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.199933:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678769920 00000100:00100000:2.0:1787075962.199944:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678769920 00000100:00100000:2.0:1787075962.200013:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 105 00000100:00100000:2.0:1787075962.200163:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+50:10537:x1873884678769920:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:2.0:1787075962.200407:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075962.200442:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad6869fc74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623559 expref: 50 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.200468:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:2.0:1787075962.200474:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787075962.201316:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.201340:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.201354:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787075962.201430:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1787075962.201457:0:5853:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000bd574282 reply state 00000000b23f6729 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075962.201479:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787075962.201616:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:10537:x1873884678769920:12345-192.168.204.50@tcp:36:bash.0 Request processed in 1455us (2319us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787075962.201627:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 105 00000020:00080000:2.0:1787075962.201634:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787075962.208037:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1787075962.208250:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.208277:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.208285:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.208293:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075962.208299:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.208307:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.208330:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:2.0:1787075962.208334:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075962.208339:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc9e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.208346:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fc9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075962.208491:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678770048 00000100:00100000:3.0:1787075962.208509:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678770048 00000100:00100000:3.0:1787075962.208596:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 106 00000100:00100000:3.0:1787075962.208609:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+51:10537:x1873884678770048:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787075962.209329:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075962.209383:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fca5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623567 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.209505:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fcac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.209521:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fcac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.209535:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fcac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075962.209574:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787075962.209579:0:5852:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787075962.209604:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fcac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.209659:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fca5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623567 expref: 53 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.209680:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fcac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623567 expref: 52 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.210080:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:3.0:1787075962.210119:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787075962.210123:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523000, rc 0) 00000100:00100000:3.0:1787075962.210222:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:10537:x1873884678770048:12345-192.168.204.50@tcp:101:bash.0 Request processed in 1614us (2208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075962.210232:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 106 00000100:00100000:3.0:1787075962.214561:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075962.215005:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678770304 00000100:00100000:1.0:1787075962.215025:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678770304 00000100:00100000:1.0:1787075962.215177:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:1.0:1787075962.215189:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:10537:x1873884678770304:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:1.0:1787075962.215671:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+53:10537:x1873884678770304:12345-192.168.204.50@tcp:35:bash.0 Request processed in 483us (1125us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1787075962.215682:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:0.0:1787075962.277526:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075962.277982:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678770432 00000100:00100000:1.0:1787075962.278001:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678770432 00000100:00100000:1.0:1787075962.278449:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 107 00000100:00100000:1.0:1787075962.278471:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+53:10543:x1873884678770432:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787075962.278515:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075962.278554:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fcb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762356e expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.278699:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fcba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.278719:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fcba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.278733:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fcba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075962.278831:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787075962.278837:0:7654:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787075962.278870:0:7654:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fcba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.278916:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fcb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762356e expref: 55 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.278962:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fcba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762356e expref: 54 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.278971:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:1.0:1787075962.278975:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787075962.278979:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf633c00, rc 0) 00000100:00100000:1.0:1787075962.279115:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+54:10543:x1873884678770432:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 653us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075962.279125:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 107 00000100:00100000:0.0:1787075962.287629:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.287811:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678770560 00000100:00100000:2.0:1787075962.287843:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678770560 00000100:00100000:2.0:1787075962.287932:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 108 00000100:00100000:2.0:1787075962.287945:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+54:10543:x1873884678770560:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787075962.287976:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075962.288004:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fcc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623575 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288472:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fcc8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288492:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fcc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288508:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fcc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288526:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fccf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288534:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288541:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288725:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fcd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288735:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fcd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288743:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fcd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075962.288820:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787075962.288826:0:5854:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787075962.288850:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fcd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288866:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fcd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288876:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fcc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288882:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fcc8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288890:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fcc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288898:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075962.288904:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fcc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288913:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fcc8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288928:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:2.0:1787075962.288931:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075962.288938:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fcc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288945:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fcc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288973:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288980:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fccf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288986:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fccf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.288992:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075962.288995:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fccf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.289001:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fccf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.289009:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996191b79f00) 00010000:00010000:2.0:1787075962.289012:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075962.289014:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fccf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.289020:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fccf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.289321:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fcc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623575 expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.289336:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fcd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623575 expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.289356:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:2.0:1787075962.289359:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787075962.289362:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9033400, rc 0) 00000100:00100000:2.0:1787075962.289511:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:10543:x1873884678770560:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1568us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075962.289521:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 108 00000100:00100000:3.0:1787075962.300904:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075962.300969:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.301156:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678770688 00000100:00100000:2.0:1787075962.301172:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678770688 00000100:00100000:2.0:1787075962.301275:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:2.0:1787075962.301289:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:2360:x1873884678770688:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075962.301345:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075962.301387:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fcd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623575 expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.301416:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:2.0:1787075962.301424:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075962.301516:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+54:2360:x1873884678770688:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 230us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075962.301525:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:1.0:1787075962.301611:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678770944 00000100:00100000:1.0:1787075962.301616:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678770944 00000100:00100000:1.0:1787075962.301700:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 109 00000100:00100000:1.0:1787075962.301708:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+54:10543:x1873884678770944:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787075962.301730:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075962.301751:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fcdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762357c expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.301913:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fce4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.301931:0:7654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fcac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623567 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.301940:0:7654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fce4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.301983:0:7654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fcac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623567 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.302007:0:7654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fcac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623567 expref: 55 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075962.302036:0:7654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bec0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1873884700803840:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787075962.302130:0:7654:0:(client.c:2702:ptlrpc_set_wait()) set ffff996185c7fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787075962.304339:0:7654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bec0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1873884700803840:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787075962.304377:0:7654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fce4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075962.304905:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.305141:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678771072 00000100:00100000:2.0:1787075962.305153:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678771072 00010000:00010000:2.0:1787075962.305204:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fcac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623567 expref: 56 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075962.305258:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:2.0:1787075962.305270:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+56:2362:x1873884678771072:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075962.305315:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075962.305324:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fcac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623567 expref: 56 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.305340:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fcac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623567 expref: 56 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.305374:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad6869fcac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623567 expref: 56 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.305398:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:2.0:1787075962.305405:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fce4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.305419:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fce4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.305428:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fce4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.305470:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075962.305554:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:2362:x1873884678771072:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 286us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075962.305562:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 52 00010000:00010000:1.0:1787075962.306252:0:7654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fce4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.306266:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fce4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075962.306292:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787075962.306527:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fcdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762357c expref: 56 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.306547:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fce4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762357c expref: 55 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.306556:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:1.0:1787075962.306559:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787075962.306562:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632400, rc 0) 00000100:00100000:1.0:1787075962.306711:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:10543:x1873884678770944:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 5003us (5741us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787075962.306738:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 109 00000100:00100000:0.0:1787075962.325131:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.325225:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678771328 00000100:00100000:2.0:1787075962.325251:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678771328 00000100:00100000:2.0:1787075962.325340:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:2.0:1787075962.325352:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a0263850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:10543:x1873884678771328:12345-192.168.204.50@tcp:103:lfs.0 00010000:00010000:2.0:1787075962.325401:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075962.325443:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad6869fc43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623552 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.325472:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:2.0:1787075962.325479:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075962.325579:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a0263850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+54:10543:x1873884678771328:12345-192.168.204.50@tcp:103:lfs.0 Request processed in 229us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075962.325588:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:0.0:1787075962.328218:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075962.328899:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678771456 00000100:00100000:3.0:1787075962.328912:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678771456 00000100:00100000:3.0:1787075962.328989:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 110 00000100:00100000:3.0:1787075962.329002:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+54:10543:x1873884678771456:12345-192.168.204.50@tcp:58:lfs.0 00010000:00010000:3.0:1787075962.329299:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fcf2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.329323:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fcf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.329339:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fcf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787075962.331550:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787075962.331763:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+54:10543:x1873884678771456:12345-192.168.204.50@tcp:58:lfs.0 Request processed in 2755us (3555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075962.332079:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 110 00000100:00100000:3.0:1787075962.336683:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.336861:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678771584 00000100:00100000:2.0:1787075962.336879:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678771584 00000100:00100000:2.0:1787075962.337034:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 111 00000100:00100000:2.0:1787075962.337050:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+54:10543:x1873884678771584:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787075962.337106:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075962.337141:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fcf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623583 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.337245:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fcf2 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.337260:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fcf9 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623583 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.337317:0:5853:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fcf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.337338:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fcf9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623583 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.337360:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:2.0:1787075962.337364:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787075962.337369:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fcf9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623583 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.337379:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032600, rc 0) 00000100:00100000:2.0:1787075962.338809:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:10543:x1873884678771584:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1748us (2163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075962.338826:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 111 00000100:00100000:0.0:1787075962.568499:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700803968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787075962.568618:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075962.568832:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700803968 00000100:00100000:2.0:1787075962.568845:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700803968 00000100:00100000:2.0:1787075962.568916:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787075962.569421:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1873884700803968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787075962.569459:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000040:00080000:3.0:1787075962.570334:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787075962.570345:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787075962.570422:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1787075962.570432:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787075962.570607:0:11694:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1873884700804096:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787075962.570999:0:11694:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9c8c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787075962.576410:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1873884700803968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7468us (7774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075962.576432:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787075962.578381:0:11694:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1873884700804096:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787075962.578928:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.579036:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678771712 00000100:00100000:2.0:1787075962.579048:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678771712 00000100:00100000:2.0:1787075962.579140:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 112 00000100:00100000:2.0:1787075962.579172:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:10544:x1873884678771712:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787075962.579249:0:5854:0:(mdt_handler.c:8026:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787075962.579416:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:10544:x1873884678771712:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 245us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075962.579432:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 112 00000100:00100000:0.0:1787075962.583677:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700803968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787075962.590288:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075962.590486:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678771840 00000100:00100000:0.0:1787075962.590501:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678771840 00000100:00100000:0.0:1787075962.590701:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 113 00000100:00100000:0.0:1787075962.590719:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:10544:x1873884678771840:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787075962.590859:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fd00 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.590895:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fd00 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.590909:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fd00 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591101:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fd07 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591148:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fd07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591161:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fd07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591200:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fd0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591209:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fd0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591215:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fd0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075962.591267:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787075962.591271:0:7654:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787075962.591285:0:7654:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fd0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591298:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fd00 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591305:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fd00 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591311:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fd00 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591317:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075962.591322:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fd00 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591336:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fd00 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591349:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996191b79600) 00010000:00010000:0.0:1787075962.591352:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075962.591356:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fd00 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591362:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fd00 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591380:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fd07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591387:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fd07 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591393:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fd07 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591398:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075962.591401:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fd07 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591408:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fd07 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591415:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff996191b7a900) 00010000:00010000:0.0:1787075962.591417:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075962.591420:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fd07 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591436:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fd07 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591455:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fd0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591461:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fd0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591467:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fd0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591472:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69e00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075962.591475:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fd0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591480:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fd0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591487:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:0.0:1787075962.591489:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075962.591492:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fd0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.591497:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad6869fd0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075962.591611:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:10544:x1873884678771840:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 Request processed in 894us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075962.591622:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 113 00000100:00100000:1.0:1787075962.596525:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.599017:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678772096 00000100:00100000:2.0:1787075962.599166:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678772096 00000100:00100000:2.0:1787075962.599343:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:2.0:1787075962.599357:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:10544:x1873884678772096:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787075962.599386:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075962.599416:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fd15 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762358a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.600010:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.600106:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.600125:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075962.600142:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787075962.600378:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.600389:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.600397:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.602004:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075962.602014:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.602147:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.602169:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:2.0:1787075962.602172:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787075962.602179:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.602186:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.602301:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fd15 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762358a expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.602314:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996191b79600) 00010000:00010000:2.0:1787075962.602316:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787075962.602321:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fd15 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762358a expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.602333:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032c00, rc 0) 00000100:00100000:2.0:1787075962.602591:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+56:10544:x1873884678772096:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 3233us (6080us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787075962.602605:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:3.0:1787075962.615744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075962.615921:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678772224 00000100:00100000:1.0:1787075962.615932:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678772224 00000100:00100000:1.0:1787075962.615996:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00100000:1.0:1787075962.616007:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+56:10544:x1873884678772224:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787075962.616049:0:5852:0:(mdt_handler.c:8026:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787075962.616164:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+56:10544:x1873884678772224:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 158us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075962.616173:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00100000:0.0:1787075962.621351:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.621733:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678772480 00000100:00100000:2.0:1787075962.621762:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678772480 00000100:00100000:2.0:1787075962.621853:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 116 00000100:00100000:2.0:1787075962.621866:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+56:10544:x1873884678772480:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787075962.621903:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075962.621908:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787075962.621958:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fcba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762356e expref: 56 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.621983:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:2.0:1787075962.621989:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787075962.622008:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fd2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623591 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787075962.622753:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787075962.623044:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.623062:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.623088:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.623165:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fd2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623591 expref: 58 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.623186:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623591 expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.623210:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996191b79f00) 00010000:00010000:2.0:1787075962.623213:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787075962.623216:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032800, rc 0) 00000100:00100000:2.0:1787075962.623319:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+57:10544:x1873884678772480:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1454us (1984us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787075962.623329:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 116 00000100:00100000:2.0:1787075962.631613:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075962.631801:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678772736 00000100:00100000:1.0:1787075962.631818:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678772736 00000100:00100000:1.0:1787075962.631887:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:1.0:1787075962.631899:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+57:10544:x1873884678772736:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787075962.631960:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075962.631992:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623591 expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632020:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996191b79f00) 00010000:00010000:1.0:1787075962.632033:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787075962.632059:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd3f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632073:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632113:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632156:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869fd46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x967179e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632163:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869fd46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x967179e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632171:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869fd46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x967179e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632256:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632263:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd3f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632269:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632276:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075962.632280:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632287:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd3f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632295:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:1.0:1787075962.632298:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075962.632302:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd3f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632313:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd3f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632323:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869fd46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x967179e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632329:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869fd46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x967179e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632335:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869fd46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x967179e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632341:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075962.632344:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869fd46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x967179e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632350:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869fd46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x967179e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632357:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x967179e7 (ffff996187c34900) 00010000:00010000:1.0:1787075962.632360:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075962.632363:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869fd46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x967179e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.632369:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869fd46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x967179e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075962.632455:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+56:10544:x1873884678772736:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 557us (864us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787075962.632463:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:0.0:1787075962.645211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.645481:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678772864 00000100:00100000:2.0:1787075962.645499:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678772864 00000100:00100000:2.0:1787075962.645603:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 118 00000100:00100000:2.0:1787075962.645616:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+56:10544:x1873884678772864:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787075962.645707:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075962.645742:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fd4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623598 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.645803:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.645821:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.645836:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.646069:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fd4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623598 expref: 58 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.646137:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623598 expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.646148:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996191b79a00) 00010000:00010000:2.0:1787075962.646153:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787075962.646157:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032800, rc 0) 00000100:00100000:2.0:1787075962.646272:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+57:10544:x1873884678772864:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 658us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075962.646282:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 118 00000100:00100000:0.0:1787075962.652178:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075962.652586:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678773120 00000100:00100000:1.0:1787075962.652603:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678773120 00000100:00100000:1.0:1787075962.652747:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 119 00000100:00100000:1.0:1787075962.652760:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+57:10544:x1873884678773120:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787075962.653110:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.653135:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.653152:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787075962.658333:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1787075962.658366:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344633724443ns, next at 345633717409ns, rc = 0 00000004:00010000:1.0:1787075962.658554:0:7654:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000656f53f6 reply state 000000000b6ea1ea transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075962.658571:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787075962.658785:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+59:10544:x1873884678773120:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 6020us (6617us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1787075962.658800:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 119 00010000:00010000:2.0:1787075962.664428:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.664464:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.664475:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.664482:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075962.664488:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.664497:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.664520:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996191b79a00) 00010000:00010000:2.0:1787075962.664524:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787075962.664530:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.664564:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fd5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075962.664780:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.664892:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678773248 00000100:00100000:2.0:1787075962.664905:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678773248 00000100:00100000:2.0:1787075962.664982:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 120 00000100:00100000:2.0:1787075962.664994:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+58:10544:x1873884678773248:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787075962.665034:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075962.665056:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fd62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762359f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.665158:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fd62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762359f expref: 59 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.665173:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fd62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762359f expref: 59 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.665192:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996191b79a00) 00010000:00010000:2.0:1787075962.665195:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787075962.665198:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032c00, rc 0) 00000100:00100000:2.0:1787075962.665265:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+59:10544:x1873884678773248:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 273us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075962.665272:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 120 00000100:00100000:1.0:1787075962.673826:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075962.674038:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678773376 00000100:00100000:3.0:1787075962.674052:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678773376 00000100:00100000:3.0:1787075962.674164:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:3.0:1787075962.674179:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2361:x1873884678773376:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787075962.675014:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:2361:x1873884678773376:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 833us (1201us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787075962.675028:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:0.0:1787075962.685579:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075962.685728:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678773632 00000100:00100000:1.0:1787075962.685742:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678773632 00000100:00100000:1.0:1787075962.685834:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:1.0:1787075962.685848:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+59:10544:x1873884678773632:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787075962.686259:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:10544:x1873884678773632:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 411us (699us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787075962.686294:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:0.0:1787075962.690595:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075962.691082:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678773888 00000100:00100000:3.0:1787075962.691098:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678773888 00000100:00100000:3.0:1787075962.691414:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 121 00000100:00100000:3.0:1787075962.691442:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:10544:x1873884678773888:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787075962.691607:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:10544:x1873884678773888:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 181us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075962.691616:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 121 00000100:00100000:1.0:1787075962.695335:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.695583:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678774016 00000100:00100000:2.0:1787075962.695598:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678774016 00000100:00100000:0.0:1787075962.696102:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 122 00000100:00100000:0.0:1787075962.696122:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:10544:x1873884678774016:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787075962.696161:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075962.696191:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68c00/0x859911ad6869fd69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76235a6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.696516:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.696535:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.696551:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075962.696602:0:5854:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787075962.696627:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.696811:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68c00/0x859911ad6869fd69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235a6 expref: 62 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.696835:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235a6 expref: 61 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.696869:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996191b79a00) 00010000:00010000:0.0:1787075962.696873:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787075962.696877:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe68000, rc 0) 00000100:00100000:0.0:1787075962.697070:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+61:10544:x1873884678774016:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 956us (1752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075962.697088:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 122 00000100:00100000:0.0:1787075962.701401:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.701559:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678774144 00000100:00100000:2.0:1787075962.701576:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678774144 00000100:00100000:2.0:1787075962.701725:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:2.0:1787075962.701738:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:2361:x1873884678774144:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787075962.701767:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075962.701798:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869fd77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76235ad expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787075962.701837:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a849d7a, blocks: 0x1 00010000:00010000:2.0:1787075962.701865:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1787075962.701871:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787075962.701883:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869fd77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235ad expref: 10 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.701908:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869fd77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235ad expref: 10 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.701934:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032400, rc 0) 00000100:00100000:2.0:1787075962.702020:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+10:2361:x1873884678774144:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 284us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075962.702027:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:1.0:1787075962.718472:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075962.718790:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678774400 00000100:00100000:0.0:1787075962.718804:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678774400 00000100:00100000:0.0:1787075962.718883:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 123 00000100:00100000:0.0:1787075962.718896:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+61:10544:x1873884678774400:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787075962.719066:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+61:10544:x1873884678774400:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 172us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075962.719085:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 123 00000100:00100000:1.0:1787075962.722504:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075962.722623:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678774528 00000100:00100000:0.0:1787075962.722635:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678774528 00000100:00100000:0.0:1787075962.722756:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:0.0:1787075962.722768:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b53ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+10:10544:x1873884678774528:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787075962.722795:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075962.722820:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad6869fd7e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76235b4 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.722863:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869fd77 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235ad expref: 11 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.722910:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787075962.722915:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787075962.722931:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad6869fd7e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235b4 expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.722982:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869fd77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235ad expref: 11 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.722998:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869fd77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235ad expref: 11 pid: 6706 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075962.723015:0:6704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf51fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1873884700804224:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787075962.723147:0:6704:0:(client.c:2702:ptlrpc_set_wait()) set ffff996189627780 going to sleep for 11 seconds 00000100:00100000:1.0:1787075962.726786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.727096:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678774656 00000100:00100000:2.0:1787075962.727109:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678774656 00010000:00010000:2.0:1787075962.727170:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869fd77 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235ad expref: 12 pid: 6706 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075962.727234:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:2.0:1787075962.727248:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+12:2362:x1873884678774656:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075962.727291:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075962.727327:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869fd77 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235ad expref: 12 pid: 6706 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.727345:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869fd77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235ad expref: 12 pid: 6706 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.727390:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787075962.727398:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787075962.727410:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad6869fd7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235b4 expref: 12 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.727423:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad6869fd7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235b4 expref: 12 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.727481:0:5838:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad6869fd7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235b4 expref: 12 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075962.727501:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf77bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5838:1873884700804352:192.168.204.50@tcp:105: 00000100:00100000:2.0:1787075962.727688:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187638b40 going to sleep for 11 seconds 00010000:00010000:0.0:1787075962.731164:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c59d9c41/0x859911ad6869fd77 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235ad expref: 12 pid: 6706 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075962.731199:0:6704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf51fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1873884700804224:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787075962.731255:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad6869fd7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235b4 expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.731274:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe68c00, rc 0) 00000100:00100000:0.0:1787075962.731360:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b53ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+11:10544:x1873884678774528:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 8593us (8872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075962.731392:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:2.0:1787075962.732774:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf77bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5838:1873884700804352:192.168.204.50@tcp:105: 00010000:00010000:2.0:1787075962.732816:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075962.732993:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+10:2362:x1873884678774656:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5746us (6221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075962.733006:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:1.0:1787075962.742410:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075962.742589:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678774784 00000100:00100000:3.0:1787075962.742605:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678774784 00002000:00100000:3.0:1787075962.742747:0:6711:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9961bec08000 x1873884678774784/t0(0) o4->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:33/0 lens 504/0 e 0 to 0 dl 1787075973 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787075962.742759:0:6711:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961bec08000 with x1873884678774784 ext(0->12) 00002000:00010000:3.0:1787075962.742767:0:6711:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9961bec08000 00000100:00100000:3.0:1787075962.742797:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:3.0:1787075962.742809:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+10:2362:x1873884678774784:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787075962.744490:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+12:2362:x1873884678774784:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 Request processed in 1664us (2084us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787075962.744515:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00002000:00100000:2.0:1787075962.744529:0:6711:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9961bec08000 x1873884678774784/t4294967308(0) o4->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:33/0 lens 504/448 e 0 to 0 dl 1787075973 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787075962.744542:0:6711:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961bec08000 with x1873884678774784 ext(0->12) 00002000:00010000:2.0:1787075962.744549:0:6711:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9961bec08000 00000100:00100000:1.0:1787075962.747576:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.748104:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678774912 00000100:00100000:2.0:1787075962.748121:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678774912 00000100:00100000:2.0:1787075962.748320:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 124 00000100:00100000:2.0:1787075962.748337:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+61:10544:x1873884678774912:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1787075962.759819:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787075962.818823:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967366 is committed 00000020:00080000:0.0:1787075962.818846:0:5874:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9961811caa80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787075962.818852:0:5874:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99619182d500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996191332540 00000020:00080000:0.0:1787075962.818857:0:5874:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99619182da00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9961b5170c00 00000020:00080000:0.0:1787075962.818879:0:5874:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1787075962.818892:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 1 00000020:00080000:0.0:1787075962.819151:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:0.0:1787075962.819171:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1787075962.819182:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1787075962.819200:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787075962.819228:0:5874:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996189361cc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787075962.819233:0:5874:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff996191784c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996189361240 00000020:00080000:0.0:1787075962.819236:0:5874:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff996191784000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9961bfd5a400 00000100:00100000:0.0:1787075962.819541:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700804480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787075962.819680:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075962.819764:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787075962.819772:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf51fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700804608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787075962.819798:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075962.819832:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf51c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700804736:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787075962.819860:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075962.819903:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700804480 00000100:00100000:0.0:1787075962.819912:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700804480 00000100:00100000:0.0:1787075962.819961:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700804608 00000100:00100000:0.0:1787075962.819965:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700804608 00000100:00100000:0.0:1787075962.819998:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700804736 00000100:00100000:0.0:1787075962.820001:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700804736 00000100:00100000:0.0:1787075962.820022:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787075962.820034:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1873884700804480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787075962.820082:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1787075962.820121:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad6869fd85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.820152:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad6869fb47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623513 expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.820162:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787075962.820168:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787075962.820174:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad6869fd85 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.820211:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad6869fb47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623513 expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.820228:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad6869fb47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623513 expref: 11 pid: 6706 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075962.820242:0:6705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a53ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1873884700804864:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787075962.820312:0:6705:0:(client.c:2702:ptlrpc_set_wait()) set ffff996189627780 going to sleep for 11 seconds 00000100:00100000:0.0:1787075962.820330:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787075962.820340:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1873884700804608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787075962.820527:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787075962.820531:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787075963 00002000:00010000:0.0:1787075962.820533:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787075962.820536:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787075962 -> 1787075963 00002000:00010000:0.0:1787075962.820538:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787075962.820589:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3311:x1873884700804608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 251us (789us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787075962.820597:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787075962.820617:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787075962.820623:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1873884700804736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787075962.820637:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1787075962.820692:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a849d79, atime: 0x6a849d7a, ctime: 0x6a849d79, blocks: 0x1 00010000:00010000:0.0:1787075962.820697:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad6869fd8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.820707:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=344s v=(0 0) 00010000:00010000:0.0:1787075962.820711:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787075962.820718:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad6869fd8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.820735:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad6869fd8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.820747:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad6869fd8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.820768:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad6869fd8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.820788:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787075962.821288:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1873884700804736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 664us (1426us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787075962.821296:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1787075962.821319:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787075962.821327:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad6869fd8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.821337:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69800 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787075962.821342:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad6869fd8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.824089:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad6869fd8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.824147:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad6869fd8c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.824157:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad6869fd8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.824203:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075962.824246:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075962.824250:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787075962.824341:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9961bf51c000/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787075962.824354:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf51c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700804736:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1787075962.824393:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787075962.824509:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:0.0:1787075962.824541:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9961bf51fb80/2, rc 0, transno 4294967309 00000100:00100000:0.0:1787075962.824547:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf51fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700804608:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1787075962.825050:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:3.0:1787075962.828264:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+15:10544:x1873884678774912:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 Request processed in 79907us (80677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075962.828292:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 124 00000100:00100000:1.0:1787075962.830988:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.831171:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678775040 00000100:00100000:2.0:1787075962.831186:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678775040 00010000:00010000:2.0:1787075962.831260:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad6869fb47 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623513 expref: 12 pid: 6706 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075962.831332:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:2.0:1787075962.831346:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+12:2362:x1873884678775040:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075962.831368:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075962.831375:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad6869fb47 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623513 expref: 12 pid: 6706 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.831391:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad6869fb47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623513 expref: 12 pid: 6706 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.831451:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787075962.831458:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787075962.831466:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad6869fd85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.831480:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad6869fd85 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.831508:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075962.831587:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+12:2362:x1873884678775040:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 244us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075962.831597:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 54 00010000:00010000:3.0:1787075962.832097:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad6869fb47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623513 expref: 11 pid: 6706 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075962.832139:0:6705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a53ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1873884700804864:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075962.832170:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad6869fd85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.832183:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad6869fd85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.832190:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad6869fd85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.832202:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad6869fd85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.832217:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad6869fd85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.832552:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787075962.833476:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3311:x1873884700804480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13439us (13790us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787075962.833489:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:1.0:1787075962.834614:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9961bf51ea00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787075962.834633:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700804480:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787075962.836469:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787075962.836492:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad6869fd85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.836514:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68600 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787075962.836520:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad6869fd85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.836534:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad6869fd85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.836569:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad6869fd85 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.836611:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad6869fd85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.837131:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075962.837136:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075962.837138:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075962.837568:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075962.837871:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678775168 00000100:00100000:2.0:1787075962.837887:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678775168 00000100:00100000:2.0:1787075962.838082:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:2.0:1787075962.838098:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+11:2359:x1873884678775168:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787075962.894342:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1787075962.894375:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1787075962.894395:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1787075962.894401:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:3.0:1787075962.897338:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678775168:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 Request processed in 59222us (59759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075962.897358:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:2.0:1787075962.902555:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075962.902692:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678775424 00000100:00100000:0.0:1787075962.902709:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678775424 00000100:00100000:0.0:1787075962.902785:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 125 00000100:00100000:0.0:1787075962.902798:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+15:10544:x1873884678775424:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787075962.902877:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075962.902916:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235a6 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.903058:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996191b79a00) 00010000:00010000:0.0:1787075962.903065:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787075962.903119:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869fd93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.903137:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869fd93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.903150:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869fd93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787075962.903619:0:7654:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000b1d7e8a7 reply state 00000000d2380609 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869fd93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075962.903745:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787075962.903888:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+16:10544:x1873884678775424:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 1089us (1345us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787075962.903898:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 125 00010000:00010000:2.0:1787075962.911048:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869fd93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.911085:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869fd93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.911095:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869fd93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.911103:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075962.911110:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869fd93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.911118:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869fd93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.911141:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996191b79a00) 00010000:00010000:2.0:1787075962.911164:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075962.911172:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869fd93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.911179:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad6869fd93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075962.911372:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075962.912156:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678775552 00000100:00100000:0.0:1787075962.912172:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678775552 00000100:00100000:0.0:1787075962.912255:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:0.0:1787075962.912268:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2361:x1873884678775552:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787075962.912898:0:8477:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787075962.912904:0:8477:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787075963 -> 1787075962 00002000:00010000:0.0:1787075962.912907:0:8477:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787075962 00002000:00010000:0.0:1787075962.912910:0:8477:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787075963 -> 1787075962 00002000:00010000:0.0:1787075962.912912:0:8477:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787075962.913088:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2361:x1873884678775552:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 820us (1720us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787075962.913099:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:1.0:1787075962.915464:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075962.915627:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678775808 00000100:00100000:0.0:1787075962.915772:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678775808 00000100:00100000:0.0:1787075962.915904:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 126 00000100:00100000:0.0:1787075962.915928:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+15:10544:x1873884678775808:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787075962.916040:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.916061:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623598 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.916110:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd9a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.916162:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623598 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.916178:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623598 expref: 15 pid: 5853 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075962.916197:0:5854:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1873884700804992:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787075962.916354:0:5854:0:(client.c:2702:ptlrpc_set_wait()) set ffff996189627240 going to sleep for 11 seconds 00000100:00100000:2.0:1787075962.924834:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075962.924943:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678775936 00000100:00100000:3.0:1787075962.924975:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678775936 00010000:00010000:3.0:1787075962.925033:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd54 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623598 expref: 16 pid: 5853 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075962.925094:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:3.0:1787075962.925106:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+16:2361:x1873884678775936:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787075962.925130:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075962.925139:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd54 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623598 expref: 16 pid: 5853 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.925156:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623598 expref: 16 pid: 5853 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.925191:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996191b79a00) 00010000:00010000:3.0:1787075962.925198:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.925221:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.925233:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd9a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.925258:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075962.925341:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+16:2361:x1873884678775936:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 236us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075962.925351:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 55 00010000:00010000:0.0:1787075962.925989:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fd54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623598 expref: 15 pid: 5853 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075962.926015:0:5854:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1873884700804992:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787075962.926048:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.926059:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.926067:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.926124:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.926132:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.926154:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.926162:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075962.926168:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.926179:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd9a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.926192:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996191b79a00) 00010000:00010000:0.0:1787075962.926196:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787075962.926200:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd9a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.926208:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad6869fd9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075962.926297:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:10544:x1873884678775808:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 Request processed in 10383us (10847us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787075962.926307:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 126 00000100:00100000:2.0:1787075962.935896:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075962.936022:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678776064 00000100:00100000:1.0:1787075962.936036:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678776064 00000100:00100000:1.0:1787075962.936126:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:1.0:1787075962.936139:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2361:x1873884678776064:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787075962.936206:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bc5ae16a/0x859911ad6869fda1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.936357:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad6869fd7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235b4 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.936393:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787075962.936399:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787075962.936405:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5ae16a/0x859911ad6869fda1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.936453:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad6869fd7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235b4 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075962.936471:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad6869fd7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235b4 expref: 7 pid: 6704 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075962.936491:0:6706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bec08a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1873884700805120:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787075962.936711:0:6706:0:(client.c:2702:ptlrpc_set_wait()) set ffff996185c7f540 going to sleep for 11 seconds 00000100:00100000:2.0:1787075962.946868:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bec08a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1873884700805120:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787075962.946930:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bc5ae16a/0x859911ad6869fda1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075962.955079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075962.955206:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678776192 00000100:00100000:0.0:1787075962.955230:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678776192 00010000:00010000:0.0:1787075962.955290:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad6869fd7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235b4 expref: 8 pid: 6704 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075962.955347:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:0.0:1787075962.955358:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf779500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2361:x1873884678776192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075962.955398:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075962.955429:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad6869fd7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235b4 expref: 8 pid: 6704 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.955444:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad6869fd7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235b4 expref: 8 pid: 6704 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.955474:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad6869fd7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235b4 expref: 8 pid: 6704 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.955495:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787075962.955501:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787075962.955509:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc5ae16a/0x859911ad6869fda1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.955521:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5ae16a/0x859911ad6869fda1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.955565:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075962.955696:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf779500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2361:x1873884678776192:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 339us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075962.955705:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 56 00010000:00010000:2.0:1787075962.955930:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bc5ae16a/0x859911ad6869fda1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.955942:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc5ae16a/0x859911ad6869fda1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.955980:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bc5ae16a/0x859911ad6869fda1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.955990:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5ae16a/0x859911ad6869fda1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.955999:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc5ae16a/0x859911ad6869fda1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.956025:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633c00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787075962.956030:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc5ae16a/0x859911ad6869fda1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.956051:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc5ae16a/0x859911ad6869fda1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.956065:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc5ae16a/0x859911ad6869fda1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075962.956084:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc5ae16a/0x859911ad6869fda1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075962.956153:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2361:x1873884678776064:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 Request processed in 20017us (20273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075962.956164:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:1.0:1787075962.961227:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075962.961339:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678776448 00000100:00100000:0.0:1787075962.961356:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678776448 00000100:00100000:0.0:1787075962.961450:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 127 00000100:00100000:0.0:1787075962.961465:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:10544:x1873884678776448:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787075962.961629:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68c00/0x859911ad6869fda8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.961807:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68c00/0x859911ad6869fda8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.961823:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68c00/0x859911ad6869fda8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.962272:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fdaf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.962290:0:7654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fd62 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762359f expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.962300:0:7654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fdaf lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.962354:0:7654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fd62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762359f expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.962375:0:7654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fd62 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762359f expref: 15 pid: 5853 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075962.962397:0:7654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1873884700805248:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787075962.962768:0:7654:0:(client.c:2702:ptlrpc_set_wait()) set ffff996189627240 going to sleep for 11 seconds 00000100:00100000:0.0:1787075962.966626:0:7654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1873884700805248:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787075962.966723:0:7654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fdaf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075962.968490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075962.968636:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678776576 00000100:00100000:3.0:1787075962.968700:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678776576 00010000:00010000:3.0:1787075962.968806:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fd62 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762359f expref: 16 pid: 5853 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075962.968865:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:3.0:1787075962.968878:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+16:2361:x1873884678776576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787075962.968898:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075962.968906:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fd62 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762359f expref: 16 pid: 5853 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.968931:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fd62 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762359f expref: 16 pid: 5853 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.968961:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fd62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762359f expref: 16 pid: 5853 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.968983:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996191b79a00) 00010000:00010000:3.0:1787075962.968990:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fdaf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.969003:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fdaf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.969012:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fdaf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075962.969049:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075962.969145:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+15:2361:x1873884678776576:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 268us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075962.969154:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 57 00010000:00010000:0.0:1787075962.969516:0:7654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fdaf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.969526:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fdaf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787075962.969870:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1787075962.970182:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1787075962.970233:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1787075962.970378:0:7654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7654:1873884700805376:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787075962.970459:0:7654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075962.970500:0:7654:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1900 going to sleep for 11 seconds 00000100:00100000:3.0:1787075962.970773:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700805376 00000100:00100000:3.0:1787075962.970783:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700805376 00000100:00100000:3.0:1787075962.971004:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787075962.971016:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7654:x1873884700805376:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787075962.971137:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7654:x1873884700805376:12345-0@lo:1000:mdt00_003.0 Request processed in 124us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075962.971147:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787075962.971222:0:7654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787075962.971229:0:7654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1787075962.971259:0:7654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9961bf51fb80, transno 4294967309 00000004:00080000:0.0:1787075962.971273:0:7654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9961bf51ea00, transno 4294967310 00000100:00100000:0.0:1787075962.971281:0:7654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7654:1873884700805376:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787075962.974089:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787075962.975392:0:7654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7654:1873884700805504:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787075962.975499:0:7654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075962.979148:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700805504 00000100:00100000:2.0:1787075962.979172:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700805504 00000100:00100000:2.0:1787075962.979263:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787075962.979274:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7654:x1873884700805504:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787075962.980435:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7654:x1873884700805504:12345-0@lo:1000:mdt00_003.0 Request processed in 1152us (4925us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787075962.980453:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787075962.981897:0:7654:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787075962.982030:0:7654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7654:1873884700805504:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787075962.982268:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fdaf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.982282:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fdaf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.982328:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fdaf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.982336:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075962.982342:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fdaf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.982353:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fdaf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.982376:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996191b79a00) 00010000:00010000:0.0:1787075962.982379:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787075962.982386:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fdaf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.982394:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad6869fdaf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.982442:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fcf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.982448:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fcf2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.982453:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fcf2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.982458:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075962.982461:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fcf2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.982476:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fcf2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.982485:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:0.0:1787075962.982487:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787075962.982497:0:7654:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fcf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623583 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.982510:0:7654:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fcf9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623583 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.982521:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fcf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623583 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.982571:0:7654:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fcf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623583 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075962.982589:0:7654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf51ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1873884700805632:192.168.204.50@tcp:105: 00000100:00100000:0.0:1787075962.983412:0:7654:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787075962.986787:0:7654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf51ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1873884700805632:192.168.204.50@tcp:105: 00010000:00010000:0.0:1787075962.986833:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fcf2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.986845:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fcf2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.986889:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fdb6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.987161:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fdb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.987177:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fdb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.987190:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fdb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.987196:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fdb6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.987204:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fdb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.987221:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075962.987226:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fdb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.987234:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fdb6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.987250:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:0.0:1787075962.987253:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075962.987258:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fdb6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.987264:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869fdb6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.987276:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68c00/0x859911ad6869fda8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.987289:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68c00/0x859911ad6869fda8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.987296:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68c00/0x859911ad6869fda8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.987301:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075962.987305:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68c00/0x859911ad6869fda8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.987311:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68c00/0x859911ad6869fda8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.987319:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:0.0:1787075962.987321:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787075962.987324:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68c00/0x859911ad6869fda8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075962.987329:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68c00/0x859911ad6869fda8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075962.987697:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+18:10544:x1873884678776448:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 26232us (26497us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1787075962.987710:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 127 00000020:00080000:0.0:1787075962.987717:0:7654:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787075962.988144:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787075962.988150:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787075962.989016:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787075962.989033:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787075962.991510:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075962.992128:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678776704 00000100:00100000:1.0:1787075962.992143:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678776704 00000100:00100000:1.0:1787075962.992234:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:1.0:1787075962.992247:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+18:10543:x1873884678776704:12345-192.168.204.50@tcp:49:lfs.0 00000100:00100000:1.0:1787075962.992455:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+18:10543:x1873884678776704:12345-192.168.204.50@tcp:49:lfs.0 Request processed in 210us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075962.998508:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:3.0:1787075962.999540:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075962.999684:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075962.999826:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678777216 00000100:00100000:0.0:1787075962.999841:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678777216 00000100:00100000:0.0:1787075962.999927:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 128 00000100:00100000:0.0:1787075962.999940:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+18:10543:x1873884678777216:12345-192.168.204.50@tcp:58:lfs.0 00000040:00080000:0.0:1787075963.000504:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1787075963.000626:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+18:10543:x1873884678777216:12345-192.168.204.50@tcp:58:lfs.0 Request processed in 687us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075963.000636:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 128 00000100:00100000:1.0:1787075963.003133:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678776960 00000100:00100000:1.0:1787075963.003162:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678776960 00000100:00100000:1.0:1787075963.003280:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:1.0:1787075963.003294:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b0114450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+18:10544:x1873884678776960:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787075963.004331:0:5855:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787075963.004473:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1787075963.004557:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075963.004579:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075963.004594:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075963.004606:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdbd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075963.004614:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdbd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075963.004623:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075963.004694:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787075963.004869:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b0114450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+20:10544:x1873884678776960:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 1572us (5332us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787075963.004881:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 32 00000020:00080000:1.0:1787075963.004896:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787075963.005933:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787075963.005950:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075963.005963:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633600 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787075963.005969:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075963.005980:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075963.006003:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff996187c34900) 00010000:00010000:0.0:1787075963.006006:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787075963.006012:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdbd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075963.006019:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075963.006049:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075963.006051:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075963.006053:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787075963.054562:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075963.056177:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678777344 00000100:00100000:1.0:1787075963.056204:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678777344 00000100:00100000:1.0:1787075963.056369:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 129 00000100:00100000:1.0:1787075963.056382:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+20:10546:x1873884678777344:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787075963.056426:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075963.056459:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad6869fdc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76235bb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075963.056566:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdcb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075963.056588:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075963.056607:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075963.056630:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fdd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075963.056692:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fdd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075963.056702:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fdd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075963.057150:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fdd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075963.057165:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fce4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762357c expref: 21 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075963.057188:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fdd9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075963.057246:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fce4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762357c expref: 21 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075963.057268:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fce4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762357c expref: 21 pid: 7654 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075963.057289:0:5852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bec09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1873884700805760:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787075963.057424:0:5852:0:(client.c:2702:ptlrpc_set_wait()) set ffff996185c7f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787075963.078400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075963.078580:0:5852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bec09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1873884700805760:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787075963.078627:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fdd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075963.079634:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678777600 00000100:00100000:3.0:1787075963.079798:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678777600 00000100:00100000:3.0:1787075963.079892:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:3.0:1787075963.079904:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+22:5599:x1873884678777600:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787075963.080545:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+23:5599:x1873884678777600:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 637us (2158us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787075963.080556:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:2.0:1787075963.098344:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075963.098459:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678777728 00000100:00100000:0.0:1787075963.098476:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678777728 00010000:00010000:0.0:1787075963.098547:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fce4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762357c expref: 23 pid: 7654 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075963.098630:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:0.0:1787075963.098675:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+23:2361:x1873884678777728:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075963.098698:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075963.098706:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fce4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762357c expref: 23 pid: 7654 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075963.098722:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fce4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762357c expref: 23 pid: 7654 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075963.098754:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fce4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762357c expref: 23 pid: 7654 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075963.098777:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:0.0:1787075963.098784:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fdd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075963.098796:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fdd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075963.098804:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fdd9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075963.098868:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787075963.098923:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fdd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.098934:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fdd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075963.098950:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+22:2361:x1873884678777728:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 309us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075963.098959:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 58 00000004:00200000:3.0:1787075963.098997:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787075963.099082:0:5852:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787075963.099111:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fdd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.099140:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fdd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.099152:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.099159:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdcb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.099167:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.099175:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075963.099181:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.099189:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdcb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.099200:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:3.0:1787075963.099203:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075963.099207:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.101947:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fdcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.101978:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fdd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.101986:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fdd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.106127:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fdd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.106137:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075963.106145:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fdd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.106157:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fdd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.106182:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff996187c34c00) 00010000:00010000:3.0:1787075963.106186:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075963.106192:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fdd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.106201:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869fdd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.106304:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad6869fdc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235bb expref: 22 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.106325:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fdd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235bb expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075963.106332:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:3.0:1787075963.106335:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787075963.106337:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf633c00, rc 0) 00000100:00100000:3.0:1787075963.106470:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+21:10546:x1873884678777344:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 50087us (51925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075963.106507:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 129 00010000:00010000:1.0:1787075963.791427:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787075964.041276:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787075964.041288:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787075964.041329:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787075964.041344:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787075964.041483:0:11694:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf69d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1873884700805888:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787075964.041589:0:11694:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787075964.045185:0:11694:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf69d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1873884700805888:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787075964.056606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075964.057104:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678777856 00000100:00100000:3.0:1787075964.057117:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678777856 00000100:00100000:3.0:1787075964.057245:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 130 00000100:00100000:3.0:1787075964.057258:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+21:10557:x1873884678777856:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000100:00080000:1.0:1787075964.058044:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:1.0:1787075964.059720:0:5853:0:(mdt_handler.c:8026:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787075964.059855:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+21:10557:x1873884678777856:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 2596us (3254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075964.059867:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 130 00000100:00100000:2.0:1787075964.062687:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075964.062733:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678778112 00000100:00100000:2.0:1787075964.062744:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678778112 00000100:00100000:2.0:1787075964.062792:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 131 00000100:00100000:2.0:1787075964.062803:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+21:10557:x1873884678778112:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787075964.063172:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075964.063197:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fde0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76235c2 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075964.063374:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fde7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075964.063389:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fde7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075964.063401:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fde7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075964.063413:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787075964.063539:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fde0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235c2 expref: 24 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075964.063556:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fde7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235c2 expref: 23 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075964.063564:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:2.0:1787075964.063567:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787075964.063570:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032800, rc 0) 00000100:00100000:2.0:1787075964.063694:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+23:10557:x1873884678778112:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 892us (1016us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787075964.063711:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 131 00000100:00100000:3.0:1787075964.078713:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075964.078869:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075964.079073:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678778240 00000100:00100000:3.0:1787075964.079089:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678778240 00000100:00100000:3.0:1787075964.079187:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:2.0:1787075964.080010:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678778496 00000100:00100000:2.0:1787075964.080021:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678778496 00000100:00100000:2.0:1787075964.080092:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 132 00000100:00100000:2.0:1787075964.080105:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+24:10557:x1873884678778496:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787075964.081001:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fdf5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075964.081026:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fdf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075964.081041:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fdf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075964.081063:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a0262050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+24:2362:x1873884678778240:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787075964.081080:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075964.081106:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fde7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235c2 expref: 24 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075964.081127:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:3.0:1787075964.081134:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075964.081233:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a0262050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+23:2362:x1873884678778240:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 187us (2536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075964.081255:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00010000:00010000:2.0:1787075964.082247:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fdf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075964.082262:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fdf5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075964.082270:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fdf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075964.082279:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9033400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075964.082286:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fdf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075964.082296:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fdf5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075964.082326:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:2.0:1787075964.082330:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787075964.082335:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fdf5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075964.082341:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fdf5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075964.082579:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+23:10557:x1873884678778496:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 2472us (3706us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787075964.082601:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 132 00000040:00080000:0.0:1787075964.082797:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787075964.082816:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787075964.083298:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787075964.083317:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787075964.091423:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075964.091512:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678778752 00000100:00100000:1.0:1787075964.091526:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678778752 00000100:00100000:1.0:1787075964.091608:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:1.0:1787075964.091629:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+23:10557:x1873884678778752:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787075964.092021:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+24:10557:x1873884678778752:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 394us (613us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1787075964.092029:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00000040:00080000:2.0:1787075964.186281:0:12115:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787075964.186297:0:12115:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787075964.186366:0:12115:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787075964.186375:0:12115:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787075964.474151:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075964.474315:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678779008 00000100:00100000:1.0:1787075964.474328:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678779008 00000100:00100000:1.0:1787075964.474411:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 133 00000100:00100000:1.0:1787075964.474425:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+24:10570:x1873884678779008:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787075964.474459:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075964.474488:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fdfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76235c9 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075964.474625:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869fe03 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075964.474700:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869fe03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075964.474714:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869fe03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075964.474728:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787075964.474870:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fdfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235c9 expref: 27 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075964.474889:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869fe03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235c9 expref: 26 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075964.474919:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:1.0:1787075964.474922:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787075964.474925:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632800, rc 0) 00000100:00100000:1.0:1787075964.474994:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+26:10570:x1873884678779008:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 572us (859us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787075964.475002:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 133 00000100:00100000:3.0:1787075964.477746:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075964.478302:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678779136 00000100:00100000:1.0:1787075964.478312:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678779136 00000100:00100000:1.0:1787075964.478359:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 134 00000100:00100000:1.0:1787075964.478368:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+26:10570:x1873884678779136:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:1.0:1787075964.478434:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fe11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075964.478451:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fe11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075964.478462:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fe11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075964.478487:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fe11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075964.478493:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fe11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075964.478500:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fe11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075964.478507:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075964.478517:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fe11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075964.478525:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fe11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075964.478537:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:1.0:1787075964.478540:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787075964.478545:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fe11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075964.478551:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869fe11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075964.478615:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+26:10570:x1873884678779136:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 247us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075964.478623:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 134 00000100:00100000:1.0:1787075964.582460:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075964.582890:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678779264 00000100:00100000:3.0:1787075964.582913:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678779264 00000100:00100000:3.0:1787075964.583157:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:3.0:1787075964.583174:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2360:x1873884678779264:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1787075964.583203:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075964.583233:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad6869fe18 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76235d0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787075964.583268:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a849d7a, atime: 0x6a849d7a, ctime: 0x6a849d7a, blocks: 0xb 00010000:00010000:3.0:1787075964.583296:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1787075964.583307:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787075964.583320:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad6869fe18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235d0 expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075964.583342:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad6869fe18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235d0 expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075964.583359:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522800, rc 0) 00000100:00100000:3.0:1787075964.583445:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2360:x1873884678779264:12345-192.168.204.50@tcp:101:cat.0 Request processed in 278us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075964.583454:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:3.0:1787075964.589101:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075964.589370:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678779392 00000100:00100000:0.0:1787075964.589381:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678779392 00002000:00100000:0.0:1787075964.589433:0:6710:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9961bf69f480 x1873884678779392/t0(0) o3->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:35/0 lens 488/0 e 0 to 0 dl 1787075975 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787075964.589446:0:6710:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961bf69f480 with x1873884678779392 ext(0->4095) 00002000:00010000:0.0:1787075964.589452:0:6710:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9961bf69f480 00000100:00100000:0.0:1787075964.589485:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:0.0:1787075964.589495:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2362:x1873884678779392:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1787075964.590199:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2362:x1873884678779392:12345-192.168.204.50@tcp:3:cat.0 Request processed in 702us (1107us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787075964.590209:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3 00002000:00100000:0.0:1787075964.590216:0:6710:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9961bf69f480 x1873884678779392/t0(0) o3->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:35/0 lens 488/4536 e 0 to 0 dl 1787075975 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787075964.590226:0:6710:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961bf69f480 with x1873884678779392 ext(0->4095) 00002000:00010000:0.0:1787075964.590230:0:6710:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9961bf69f480 00000100:00080000:1.0:1787075964.591554:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787075964.807991:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787075965.772721:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1787075965.772743:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:2.0:1787075965.833217:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787075966.664132:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf69ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700806272:0@lo:400:kworker.0 00000100:00100000:3.0:1787075966.664204:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075966.664279:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787075966.664286:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf69ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700806144:0@lo:400:kworker.0 00000100:00100000:3.0:1787075966.664307:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075966.664324:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700806656:0@lo:400:kworker.0 00000100:00100000:3.0:1787075966.664349:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075966.664385:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700806272 00000100:00100000:3.0:1787075966.664394:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700806272 00000100:00100000:3.0:1787075966.664448:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700806144 00000100:00100000:3.0:1787075966.664450:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700806144 00000100:00100000:3.0:1787075966.664470:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787075966.664479:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700806272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075966.664626:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf69dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700806016:0@lo:400:kworker.0 00000100:00080000:2.0:1787075966.664660:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787075966.664696:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787075966.664705:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700806784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075966.664763:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf69d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700806400:0@lo:400:kworker.0 00000100:00100000:2.0:1787075966.673751:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075966.673840:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700806784 00000100:00100000:2.0:1787075966.673850:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700806784 00000100:00100000:2.0:1787075966.673920:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787075966.673930:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1873884700806784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787075966.673967:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075966.674045:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1873884700806784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075966.674052:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787075966.675141:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075966.676797:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700806272:12345-0@lo:400:kworker.0 Request processed in 12311us (12585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075966.676811:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787075966.676862:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787075966.676876:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700806144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075966.676930:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700806144:12345-0@lo:400:kworker.0 Request processed in 61us (12622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075966.676935:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1787075966.678539:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787075966.678622:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf77a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700806784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075966.678684:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf69ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700806144:0@lo:400:kworker.0 00000100:00100000:1.0:1787075966.678697:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf69ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700806272:0@lo:400:kworker.0 00000100:00100000:0.0:1787075966.680075:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075966.680143:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf69e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873884700806528:0@lo:400:kworker.0 00000100:00100000:0.0:1787075966.680210:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075966.681786:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700806016 00000100:00100000:0.0:1787075966.681797:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700806016 00000100:00100000:0.0:1787075966.681921:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787075966.681930:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700806016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075966.681993:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700806016:12345-0@lo:400:kworker.0 Request processed in 64us (1923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075966.682013:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787075966.682073:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf69dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700806016:0@lo:400:kworker.0 00000100:00100000:0.0:1787075966.682122:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700806528 00000100:00100000:0.0:1787075966.682126:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700806528 00000100:00100000:0.0:1787075966.682171:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787075966.682178:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873884700806528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075966.682213:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873884700806528:12345-0@lo:400:kworker.0 Request processed in 36us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075966.682286:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1787075966.682303:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787075966.682324:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf69e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873884700806528:0@lo:400:kworker.0 00000100:00100000:3.0:1787075966.683782:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700806656 00000100:00100000:3.0:1787075966.683792:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700806656 00000100:00100000:3.0:1787075966.683900:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700806400 00000100:00100000:3.0:1787075966.683905:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700806400 00000100:00100000:3.0:1787075966.683946:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787075966.683956:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1873884700806656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075966.684065:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1873884700806656:12345-0@lo:400:kworker.0 Request processed in 111us (19714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075966.684073:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787075966.684088:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787075966.684094:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700806400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075966.684130:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700806400:12345-0@lo:400:kworker.0 Request processed in 37us (8994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075966.684137:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787075966.684171:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787075966.684178:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1787075966.684197:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9961bf51c000, transno 4294967304 00000100:00100000:3.0:1787075966.684210:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf69d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700806400:0@lo:400:kworker.0 00000100:00080000:0.0:1787075966.684391:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787075966.685485:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700806656:0@lo:400:kworker.0 00010000:00010000:0.0:1787075966.856258:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075967.261089:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075967.261139:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075967.261170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075967.261207:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075967.261239:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075967.261314:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678780032 00000100:00100000:1.0:1787075967.261323:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678780032 00000100:00100000:1.0:1787075967.261397:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678779648 00000100:00100000:1.0:1787075967.261414:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678779648 00000100:00100000:1.0:1787075967.261443:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 137 00000100:00100000:1.0:1787075967.261453:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2359:x1873884678780032:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075967.261780:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678779520 00000100:00100000:2.0:1787075967.261785:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678779520 00000100:00100000:2.0:1787075967.261819:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 286 00000100:00100000:2.0:1787075967.261828:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2359:x1873884678779520:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075967.261960:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2359:x1873884678780032:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 507us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075967.261968:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 137 00000100:00100000:1.0:1787075967.262000:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 138 00000100:00100000:1.0:1787075967.262008:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+26:2359:x1873884678779648:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075967.262035:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+26:2359:x1873884678779648:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 28us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075967.262041:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 138 00000100:00080000:1.0:1787075967.262067:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787075967.264087:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2359:x1873884678779520:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 2246us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075967.264102:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 286 00000100:00100000:3.0:1787075967.266397:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678779776 00000100:00100000:3.0:1787075967.266423:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678779776 00000100:00100000:2.0:1787075967.267188:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678779904 00000100:00100000:2.0:1787075967.267204:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678779904 00000100:00100000:2.0:1787075967.267235:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:2.0:1787075967.267248:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2359:x1873884678779776:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075967.267345:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2359:x1873884678779776:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 99us (6204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075967.267353:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:2.0:1787075967.267375:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:2.0:1787075967.267383:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2359:x1873884678779904:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075967.267408:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2359:x1873884678779904:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 27us (6168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075967.267415:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00080000:1.0:1787075967.269509:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787075967.269524:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787075967.692407:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bec09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700806912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787075967.692506:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075967.696925:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700806912 00000100:00100000:2.0:1787075967.696949:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700806912 00000100:00100000:2.0:1787075967.697026:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787075967.697037:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700806912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787075967.697077:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075967.697184:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700806912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (4677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075967.697191:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787075967.697242:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bec09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700806912:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787075967.879922:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787075968.201898:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787075968.201910:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787075968.201950:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787075968.201958:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1787075968.307093:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000020:00080000:2.0:1787075968.307124:0:5874:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996191be1600 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787075968.307131:0:5874:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99619182db00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996191be1900 00000020:00080000:2.0:1787075968.307135:0:5874:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff99619182d900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9961a4c42400 00000020:00080000:2.0:1787075968.307166:0:5874:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1787075968.307170:0:5874:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000001:00080000:2.0:1787075968.307177:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1787075968.307371:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1787075968.307567:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1787075968.310527:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1787075968.310545:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:0.0:1787075968.904037:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075969.927959:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075969.987342:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075969.990371:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678780160 00000100:00100000:1.0:1787075969.990391:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678780160 00000100:00100000:1.0:1787075969.990554:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 135 00000100:00100000:1.0:1787075969.990568:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:10223:x1873884678780160:12345-192.168.204.50@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787075969.990727:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:10223:x1873884678780160:12345-192.168.204.50@tcp:60:lhsmtool_posix.0 Request processed in 162us (3397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075969.990735:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 135 00000100:00080000:0.0:1787075969.993127:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787075969.994697:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075969.994784:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678780416 00000100:00100000:1.0:1787075969.994794:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678780416 00000100:00100000:1.0:1787075969.994856:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:1.0:1787075969.994866:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:10223:x1873884678780416:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787075969.995410:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:10223:x1873884678780416:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 544us (720us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787075969.995423:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:3.0:1787075970.272897:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075970.273099:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678780544 00000100:00100000:1.0:1787075970.273111:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678780544 00000100:00100000:1.0:1787075970.273193:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 136 00000100:00100000:1.0:1787075970.273203:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:11023:x1873884678780544:12345-192.168.204.50@tcp:101:lsof.0 00010000:00010000:1.0:1787075970.273224:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075970.273244:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fe1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76235d7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075970.273314:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fe26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075970.273328:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fe26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075970.273341:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fe26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787075970.273542:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1787075970.273908:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787075970.273913:0:5853:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787075970.274063:0:5853:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fe26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075970.274215:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869fe1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235d7 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075970.274238:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fe26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235d7 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075970.274262:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ab00) 00010000:00010000:1.0:1787075970.274266:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787075970.274270:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632400, rc 0) 00000100:00100000:1.0:1787075970.274378:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:11023:x1873884678780544:12345-192.168.204.50@tcp:101:lsof.0 Request processed in 1176us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075970.274388:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 136 00010000:00010000:0.0:1787075970.952025:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075971.784122:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf69ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700807424:0@lo:400:kworker.0 00000100:00100000:2.0:1787075971.784197:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075971.784261:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787075971.784268:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700807040:0@lo:400:kworker.0 00000100:00100000:2.0:1787075971.784296:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075971.784323:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf69ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700807552:0@lo:400:kworker.0 00000100:00100000:2.0:1787075971.784361:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075971.784408:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700807040 00000100:00100000:2.0:1787075971.784416:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700807040 00000100:00100000:2.0:1787075971.784461:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787075971.784470:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700807040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075971.784518:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700807040:12345-0@lo:400:kworker.0 Request processed in 49us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075971.784525:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787075971.784682:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700807040:0@lo:400:kworker.0 00000100:00100000:0.0:1787075971.784957:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf69dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700807296:0@lo:400:kworker.0 00000100:00100000:0.0:1787075971.784991:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075971.785014:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787075971.785020:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf69e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700807168:0@lo:400:kworker.0 00000100:00100000:0.0:1787075971.785056:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075971.785070:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf69d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700807680:0@lo:400:kworker.0 00000100:00100000:0.0:1787075971.785087:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075971.785159:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700807424 00000100:00100000:3.0:1787075971.785164:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700807424 00000100:00100000:3.0:1787075971.785203:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700807680 00000100:00100000:3.0:1787075971.785206:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700807680 00000100:00100000:3.0:1787075971.785227:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787075971.785234:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700807424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075971.785283:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700807424:12345-0@lo:400:kworker.0 Request processed in 49us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075971.785289:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787075971.785302:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787075971.785307:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700807680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075971.785335:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700807680:12345-0@lo:400:kworker.0 Request processed in 28us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075971.785353:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787075971.785480:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700807552 00000100:00100000:2.0:1787075971.785484:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700807552 00000100:00100000:2.0:1787075971.785518:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700807296 00000100:00100000:2.0:1787075971.785521:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700807296 00000100:00100000:2.0:1787075971.785532:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700807168 00000100:00100000:2.0:1787075971.785535:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700807168 00000100:00100000:2.0:1787075971.785546:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787075971.785551:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700807552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075971.785583:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700807552:12345-0@lo:400:kworker.0 Request processed in 32us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075971.785589:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787075971.785601:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787075971.785606:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700807296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075971.785628:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700807296:12345-0@lo:400:kworker.0 Request processed in 23us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075971.785633:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787075971.785664:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787075971.785670:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700807168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075971.785692:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700807168:12345-0@lo:400:kworker.0 Request processed in 24us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075971.785704:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1787075971.785886:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787075971.785891:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787075971.785893:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787075971.785928:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf69e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700807168:0@lo:400:kworker.0 00000100:00100000:0.0:1787075971.785937:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1787075971.785943:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1787075971.785962:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf69d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700807680:0@lo:400:kworker.0 00000100:00100000:0.0:1787075971.785973:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf69dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700807296:0@lo:400:kworker.0 00000100:00100000:0.0:1787075971.786037:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf69ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700807552:0@lo:400:kworker.0 00000100:00100000:0.0:1787075971.786050:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf69ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700807424:0@lo:400:kworker.0 00000100:00100000:1.0:1787075971.788379:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787075971.791566:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700807808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075971.792011:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075971.792162:0:9220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700807808 00000100:00100000:2.0:1787075971.792181:0:9220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700807808 00000100:00100000:2.0:1787075971.792256:0:9220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787075971.792268:0:9220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700807808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787075971.792319:0:9220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075971.792393:0:9220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700807808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075971.792401:0:9220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787075971.793606:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700807808:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787075971.976049:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075972.381193:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075972.381246:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075972.381277:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075972.381374:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075972.381417:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678780928 00000100:00100000:3.0:1787075972.381428:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678780928 00000100:00100000:3.0:1787075972.381497:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00100000:3.0:1787075972.381508:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2360:x1873884678780928:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075972.381580:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2360:x1873884678780928:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 75us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075972.381588:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00080000:3.0:1787075972.381612:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787075972.382146:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678780672 00000100:00100000:0.0:1787075972.382154:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678780672 00000100:00100000:0.0:1787075972.382190:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 288 00000100:00100000:0.0:1787075972.382196:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2360:x1873884678780672:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075972.382231:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2360:x1873884678780672:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 35us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075972.382249:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 288 00000100:00100000:2.0:1787075972.387971:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075972.388051:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678781056 00000100:00100000:0.0:1787075972.388062:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678781056 00000100:00100000:0.0:1787075972.388142:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:0.0:1787075972.388153:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2360:x1873884678781056:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075972.388218:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2360:x1873884678781056:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 67us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075972.388227:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00080000:2.0:1787075972.388384:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787075972.391280:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678781184 00000100:00100000:1.0:1787075972.391296:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678781184 00000100:00100000:1.0:1787075972.391389:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678780800 00000100:00100000:1.0:1787075972.391393:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678780800 00000100:00100000:1.0:1787075972.391424:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 142 00000100:00100000:1.0:1787075972.391435:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:2360:x1873884678781184:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075972.391513:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:2360:x1873884678781184:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 79us (10233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075972.391521:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 142 00000100:00100000:1.0:1787075972.391540:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 143 00000100:00100000:1.0:1787075972.391547:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:2360:x1873884678780800:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075972.391579:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:2360:x1873884678780800:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 33us (10205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075972.391585:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 143 00000100:00080000:2.0:1787075972.391741:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787075972.808905:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bec08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700807936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787075972.808991:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075972.809247:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700807936 00000100:00100000:1.0:1787075972.809256:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700807936 00000100:00100000:1.0:1787075972.809306:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787075972.809316:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700807936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787075972.809358:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075972.809523:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700807936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 208us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075972.809533:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787075972.809629:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bec08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700807936:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787075973.000595:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787075973.404502:0:5874:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:3.0:1787075973.404542:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1787075973.404596:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787075973.404609:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1787075974.033588:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787075974.460983:0:12318:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 13:59:33 (1787075973) 00010000:00010000:1.0:1787075975.048105:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075976.074139:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075976.108969:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075976.114508:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678781440 00000100:00100000:1.0:1787075976.114527:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678781440 00000100:00100000:1.0:1787075976.114628:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 137 00000100:00100000:1.0:1787075976.114662:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:11288:x1873884678781440:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787075976.114685:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075976.114711:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869fe2d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76235de expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.114798:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe34 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.114827:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.114839:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.114928:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe3b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.114936:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.114943:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.115820:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad6869fe42 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.115835:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad6869fe42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.115844:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad6869fe42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075976.115856:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787075976.116095:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.116104:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe34 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.116112:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.116118:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075976.116124:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.116143:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe34 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.116157:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff996194304300) 00010000:00010000:1.0:1787075976.116160:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075976.116164:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.116170:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.116184:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.116189:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe3b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.116195:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.116200:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075976.116202:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.116208:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe3b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.116214:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff996187c34800) 00010000:00010000:1.0:1787075976.116217:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075976.116219:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe3b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.116234:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe3b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787075976.117526:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787075976.117841:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869fe2d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235de expref: 16 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.117867:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad6869fe42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235de expref: 15 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.117876:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996191b79600) 00010000:00010000:1.0:1787075976.117879:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075976.117883:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf633000, rc 0) 00000100:00100000:1.0:1787075976.118010:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+15:11288:x1873884678781440:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 3373us (9119us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787075976.118019:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 137 00000100:00100000:2.0:1787075976.124294:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075976.124382:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075976.124461:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678781696 00000100:00100000:1.0:1787075976.124478:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678781696 00000100:00100000:1.0:1787075976.124567:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:1.0:1787075976.124588:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+15:2359:x1873884678781696:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787075976.124605:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075976.124634:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad6869fe42 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235de expref: 15 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075976.124687:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996191b79600) 00010000:00010000:1.0:1787075976.124694:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075976.124764:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678781568 00000100:00100000:1.0:1787075976.124765:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1847b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:2359:x1873884678781696:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 188us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075976.124777:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678781568 00000100:00100000:1.0:1787075976.124794:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:0.0:1787075976.125182:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 138 00000100:00100000:0.0:1787075976.125197:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:11288:x1873884678781568:12345-192.168.204.50@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787075976.125280:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:11288:x1873884678781568:12345-192.168.204.50@tcp:59:lhsmtool_posix.0 Request processed in 89us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075976.125288:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 138 00000040:00080000:3.0:1787075976.391912:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787075976.391922:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787075976.392455:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787075976.392473:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787075976.906320:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787075976.906343:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700808064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075976.906416:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075976.906830:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700808192:0@lo:400:kworker.0 00000100:00100000:0.0:1787075976.906876:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075976.906902:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873884700808704:0@lo:400:kworker.0 00000100:00100000:0.0:1787075976.906931:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075976.906972:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787075976.906977:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700808320:0@lo:400:kworker.0 00000100:00100000:0.0:1787075976.907000:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075976.907030:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700808448:0@lo:400:kworker.0 00000100:00100000:0.0:1787075976.907051:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075976.907070:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787075976.907075:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700808576:0@lo:400:kworker.0 00000100:00100000:0.0:1787075976.907097:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075976.907126:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700808704 00000100:00100000:0.0:1787075976.907136:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700808704 00000100:00100000:0.0:1787075976.907192:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700808320 00000100:00100000:0.0:1787075976.907195:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700808320 00000100:00100000:0.0:1787075976.907207:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700808448 00000100:00100000:0.0:1787075976.907209:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700808448 00000100:00100000:0.0:1787075976.907230:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787075976.907241:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873884700808704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075976.907323:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873884700808704:12345-0@lo:400:kworker.0 Request processed in 82us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075976.907331:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787075976.907350:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787075976.907357:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700808320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075976.907385:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700808320:12345-0@lo:400:kworker.0 Request processed in 30us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075976.907390:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787075976.907401:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787075976.907407:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700808448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787075976.907436:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700808448:12345-0@lo:400:kworker.0 Request processed in 29us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075976.907448:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787075976.907485:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700808320:0@lo:400:kworker.0 00000100:00100000:0.0:1787075976.907494:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873884700808704:0@lo:400:kworker.0 00000100:00100000:0.0:1787075976.907523:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700808448:0@lo:400:kworker.0 00000100:00100000:2.0:1787075976.909714:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700808064 00000100:00100000:2.0:1787075976.909731:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700808064 00000100:00100000:2.0:1787075976.909813:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787075976.909828:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700808064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787075976.909877:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075976.909975:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700808064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (3559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075976.909990:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787075976.910023:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700808192 00000100:00100000:2.0:1787075976.910027:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700808192 00000100:00100000:2.0:1787075976.910054:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787075976.910061:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3311:x1873884700808192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075976.910103:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3311:x1873884700808192:12345-0@lo:400:kworker.0 Request processed in 42us (3226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075976.910110:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:2.0:1787075976.910141:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787075976.910146:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787075976.910192:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700808064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787075976.910233:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700808192:0@lo:400:kworker.0 00000100:00100000:3.0:1787075976.910528:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700808576 00000100:00100000:3.0:1787075976.910534:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700808576 00000100:00100000:3.0:1787075976.910589:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787075976.910610:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700808576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075976.910680:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700808576:12345-0@lo:400:kworker.0 Request processed in 73us (3582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075976.910688:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1787075976.910971:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787075976.910997:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700808576:0@lo:400:kworker.0 00010000:00010000:1.0:1787075977.096786:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075977.506776:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075977.506836:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075977.506907:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075977.506928:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075977.506963:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075977.507008:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678781952 00000100:00100000:2.0:1787075977.507022:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678781952 00000100:00100000:2.0:1787075977.507091:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678782336 00000100:00100000:2.0:1787075977.507095:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678782336 00000100:00100000:3.0:1787075977.507185:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678782208 00000100:00100000:3.0:1787075977.507191:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678782208 00000100:00100000:0.0:1787075977.507232:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 147 00000100:00100000:0.0:1787075977.507250:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:2359:x1873884678781952:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075977.507377:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:2359:x1873884678781952:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 132us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075977.507387:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 147 00000100:00100000:0.0:1787075977.507427:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678782080 00000100:00100000:0.0:1787075977.507430:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678782080 00000100:00100000:2.0:1787075977.508993:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 148 00000100:00100000:2.0:1787075977.509028:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:2360:x1873884678782336:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075977.509155:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:2360:x1873884678782336:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 145us (2191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075977.509165:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 148 00000100:00100000:0.0:1787075977.513133:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:0.0:1787075977.513161:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678782208:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075977.513293:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678782208:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 143us (6454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075977.513301:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:0.0:1787075977.513336:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 76 00000100:00100000:0.0:1787075977.513345:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2360:x1873884678782080:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075977.513373:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2360:x1873884678782080:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 30us (6444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075977.513380:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 76 00000100:00100000:3.0:1787075977.514121:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678781824 00000100:00100000:3.0:1787075977.514138:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678781824 00000100:00100000:3.0:1787075977.514196:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 290 00000100:00100000:3.0:1787075977.514205:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2360:x1873884678781824:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075977.514250:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2360:x1873884678781824:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 46us (7342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075977.514258:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 290 00000100:00080000:2.0:1787075977.524227:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787075977.524244:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787075977.524249:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075977.933680:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bec08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700808832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787075977.933815:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075977.933921:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700808832 00000100:00100000:1.0:1787075977.933930:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700808832 00000100:00100000:1.0:1787075977.934661:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787075977.934676:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700808832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787075977.934731:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075977.934825:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700808832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075977.934834:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787075977.935713:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bec08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700808832:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787075978.120918:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787075978.440111:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787075978.440128:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787075978.440720:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787075978.440731:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1787075978.489697:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:0.0:1787075978.544442:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075978.544564:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678782464 00000100:00100000:1.0:1787075978.544592:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678782464 00000100:00100000:1.0:1787075978.544729:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 139 00000100:00100000:1.0:1787075978.544743:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:11330:x1873884678782464:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787075978.544785:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075978.546418:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76235e5 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.546532:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787075978.546618:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787075978.546900:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.546913:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.546933:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fe5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.546941:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fe5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.546948:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fe5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.547286:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.547295:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.547302:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.547309:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075978.547314:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.547321:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.547334:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ab00) 00010000:00010000:1.0:1787075978.547343:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075978.547349:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.547355:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad6869fe57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.547368:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fe5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.547374:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fe5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.547380:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fe5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.547386:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075978.547389:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fe5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.547395:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fe5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.547403:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff996187c34a00) 00010000:00010000:1.0:1787075978.547406:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075978.547409:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fe5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.547414:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869fe5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.547450:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe50 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235e5 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.547474:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ab00) 00010000:00010000:1.0:1787075978.547476:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075978.547480:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235e5 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.547490:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632000, rc 0) 00000100:00100000:1.0:1787075978.550387:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:11330:x1873884678782464:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 5361us (5675us total) trans 0 rc 301/301 00000100:00100000:1.0:1787075978.550404:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 139 00000100:00100000:0.0:1787075978.563025:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075978.563232:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678782720 00000100:00100000:3.0:1787075978.563246:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678782720 00000100:00100000:3.0:1787075978.563336:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 140 00000100:00100000:3.0:1787075978.563349:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:11330:x1873884678782720:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:3.0:1787075978.563438:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075978.563477:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69600/0x859911ad6869f7ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762341e expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.563519:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ab00) 00010000:00010000:3.0:1787075978.563526:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787075978.564430:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fe65 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.564458:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fe26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235d7 expref: 5 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.564468:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fe65 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.564518:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fe26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235d7 expref: 5 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.564538:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fe26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235d7 expref: 5 pid: 5853 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075978.564556:0:5854:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf69c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1873884700808960:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787075978.565740:0:5854:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787075978.573119:0:5854:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf69c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1873884700808960:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075978.573188:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fe65 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075978.574902:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075978.575574:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678782848 00000100:00100000:3.0:1787075978.575592:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678782848 00010000:00010000:3.0:1787075978.575704:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fe26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235d7 expref: 6 pid: 5853 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075978.575793:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:3.0:1787075978.575808:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:2362:x1873884678782848:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787075978.575836:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075978.575846:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fe26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235d7 expref: 6 pid: 5853 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.575862:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fe26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235d7 expref: 6 pid: 5853 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.575895:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869fe26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235d7 expref: 6 pid: 5853 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.575924:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ab00) 00010000:00010000:3.0:1787075978.575932:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fe65 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.575944:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fe65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.575953:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fe65 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.575997:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787075978.576099:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fe65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075978.576102:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2362:x1873884678782848:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 296us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075978.576124:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 59 00010000:00010000:1.0:1787075978.576134:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fe65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.576179:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe6c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.576197:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.576209:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075978.577530:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787075978.577544:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fe65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.577553:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fe65 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.577566:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fe65 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.577573:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075978.577578:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fe65 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.577586:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fe65 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.577604:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ab00) 00010000:00010000:1.0:1787075978.577607:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075978.577612:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fe65 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075978.577618:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad6869fe65 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787075978.577665:0:5854:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 0000000060b93e23 reply state 00000000e8f96c39 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075978.577674:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787075978.577779:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:11330:x1873884678782720:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 14418us (14755us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787075978.577789:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 140 00010000:00010000:3.0:1787075978.580480:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.580516:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe6c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.580525:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe6c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.580532:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075978.580539:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe6c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.580548:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe6c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.580570:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff996187c34a00) 00010000:00010000:3.0:1787075978.580574:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075978.580579:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe6c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.580586:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad6869fe6c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075978.654898:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075978.654944:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678782976 00000100:00100000:0.0:1787075978.654955:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678782976 00000100:00100000:0.0:1787075978.655015:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 141 00000100:00100000:0.0:1787075978.655026:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:11339:x1873884678782976:12345-192.168.204.50@tcp:101:lctl.0 00010000:00010000:0.0:1787075978.655052:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075978.655074:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68c00/0x859911ad6869fe73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76235ec expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075978.655140:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869fe7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075978.655156:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869fe7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075978.655167:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869fe7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075978.655238:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787075978.655242:0:7654:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787075978.655268:0:7654:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869fe7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075978.655294:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68c00/0x859911ad6869fe73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235ec expref: 15 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075978.655312:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869fe7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235ec expref: 14 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075978.655338:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ae00) 00010000:00010000:0.0:1787075978.655341:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787075978.655345:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe68400, rc 0) 00000100:00100000:0.0:1787075978.655411:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:11339:x1873884678782976:12345-192.168.204.50@tcp:101:lctl.0 Request processed in 387us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075978.655418:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 141 00000100:00100000:0.0:1787075978.721407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075978.721585:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678783104 00000100:00100000:3.0:1787075978.721603:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678783104 00000100:00100000:2.0:1787075978.722071:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 142 00000100:00100000:2.0:1787075978.722091:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+14:11345:x1873884678783104:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1787075978.722119:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075978.722149:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fe81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76235f3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722235:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fe88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722251:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fe88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722265:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fe88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722280:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fe8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722287:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fe8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722294:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fe8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722425:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fe96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722433:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fe96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722440:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fe96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075978.722476:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787075978.722480:0:5853:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787075978.722508:0:5853:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fe96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722521:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fe88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722528:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fe88 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722535:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fe88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722542:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9033400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075978.722546:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fe88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722552:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fe88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722564:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ae00) 00010000:00010000:2.0:1787075978.722574:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075978.722580:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fe88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722586:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033400/0x859911ad6869fe88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722602:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fe8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722608:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fe8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722613:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fe8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722617:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9032800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075978.722619:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fe8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722625:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fe8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722631:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99619211ce00) 00010000:00010000:2.0:1787075978.722634:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075978.722679:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fe8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722688:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032800/0x859911ad6869fe8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722727:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032c00/0x859911ad6869fe81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235f3 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722755:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fe96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235f3 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.722777:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:2.0:1787075978.722779:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787075978.722782:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961b9032400, rc 0) 00000100:00100000:2.0:1787075978.722878:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+15:11345:x1873884678783104:12345-192.168.204.50@tcp:101:bash.0 Request processed in 793us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075978.722887:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 142 00000100:00100000:0.0:1787075978.727545:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075978.727677:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678783360 00000100:00100000:2.0:1787075978.727688:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678783360 00000100:00100000:2.0:1787075978.727748:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 143 00000100:00100000:2.0:1787075978.727758:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+15:11345:x1873884678783360:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1787075978.727790:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075978.727838:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad6869fe9d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76235fa expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.727995:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad6869fea4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.728012:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad6869fea4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.728023:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad6869fea4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.728085:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad6869feab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.728101:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad6869feab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.728108:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad6869feab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787075978.728745:0:7654:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787075978.728933:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad6869feb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.728945:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad6869feb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.728954:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad6869feb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.728991:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad6869fea4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.728999:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad6869fea4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.729004:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad6869fea4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.729011:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075978.729016:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad6869fea4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.729023:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad6869fea4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.729047:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:2.0:1787075978.729050:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075978.729055:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad6869fea4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.729061:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad6869fea4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787075978.729074:0:7654:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 000000009607977d reply state 00000000bea6974f transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad6869feab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075978.729083:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787075978.729121:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad6869fe9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235fa expref: 18 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.729135:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad6869feb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235fa expref: 17 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.729143:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99619211cb00) 00010000:00010000:2.0:1787075978.729145:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787075978.729147:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1840e00, rc 0) 00000100:00100000:2.0:1787075978.729229:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+18:11345:x1873884678783360:12345-192.168.204.50@tcp:101:bash.0 Request processed in 1472us (1694us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787075978.729237:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 143 00010000:00010000:2.0:1787075978.734090:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad6869feab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.734112:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad6869feab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.734145:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad6869feab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.734151:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075978.734156:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad6869feab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.734165:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad6869feab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.734183:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99619211c300) 00010000:00010000:2.0:1787075978.734186:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075978.734191:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad6869feab lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.734197:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad6869feab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075978.738479:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075978.741733:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678783488 00000100:00100000:3.0:1787075978.741771:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678783488 00000100:00100000:3.0:1787075978.741879:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:3.0:1787075978.741898:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2361:x1873884678783488:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787075978.741926:0:8477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075978.741956:0:8477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869fec0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623601 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787075978.742018:0:8477:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787075978.742049:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1787075978.742055:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787075978.742068:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869fec0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623601 expref: 6 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.742096:0:8477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869fec0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623601 expref: 6 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.742117:0:8477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523a00, rc 0) 00000100:00100000:3.0:1787075978.742227:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2361:x1873884678783488:12345-192.168.204.50@tcp:101:bash.0 Request processed in 336us (3759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075978.742236:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:0.0:1787075978.748266:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075978.749491:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678783616 00000100:00100000:2.0:1787075978.749503:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678783616 00000100:00100000:2.0:1787075978.749581:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:2.0:1787075978.749592:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:11345:x1873884678783616:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1787075978.749610:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075978.749631:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce31b2d8/0x859911ad6869fec7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623608 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.749706:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869fec0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623601 expref: 7 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.749739:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787075978.749746:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787075978.749752:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce31b2d8/0x859911ad6869fec7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623608 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.749815:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869fec0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623601 expref: 7 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.749832:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869fec0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623601 expref: 7 pid: 8477 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075978.749851:0:6706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1847800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1873884700809088:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787075978.749970:0:6706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616600 going to sleep for 11 seconds 00000100:00100000:1.0:1787075978.754587:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075978.754861:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1847800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1873884700809088:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787075978.754907:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ce31b2d8/0x859911ad6869fec7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623608 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.754934:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1840800, rc 0) 00000100:00100000:2.0:1787075978.755015:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:11345:x1873884678783616:12345-192.168.204.50@tcp:101:bash.0 Request processed in 5423us (6759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075978.755026:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:3.0:1787075978.758489:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678783744 00000100:00100000:3.0:1787075978.758509:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678783744 00010000:00010000:3.0:1787075978.758577:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869fec0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623601 expref: 7 pid: 8477 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075978.758698:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:3.0:1787075978.758710:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2361:x1873884678783744:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787075978.758732:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075978.759213:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869fec0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623601 expref: 7 pid: 8477 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.759250:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869fec0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623601 expref: 7 pid: 8477 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.759279:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869fec0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623601 expref: 7 pid: 8477 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.759297:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787075978.759302:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787075978.759310:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce31b2d8/0x859911ad6869fec7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623608 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.759321:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce31b2d8/0x859911ad6869fec7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623608 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075978.759504:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ce31b2d8/0x859911ad6869fec7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623608 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075978.759550:0:5837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1847800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5837:1873884700809216:192.168.204.50@tcp:105: 00000100:00100000:2.0:1787075978.759683:0:5837:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616600 going to sleep for 11 seconds 00000100:00100000:1.0:1787075978.763752:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075978.763867:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678784000 00000100:00100000:3.0:1787075978.763884:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678784000 00000100:00100000:3.0:1787075978.763957:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:3.0:1787075978.763966:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+17:11345:x1873884678784000:12345-192.168.204.50@tcp:35:bash.0 00000001:00080000:3.0:1787075978.764319:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967418 00000100:00100000:3.0:1787075978.764433:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+19:11345:x1873884678784000:12345-192.168.204.50@tcp:35:bash.0 Request processed in 468us (696us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1787075978.764441:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 36 00000020:00080000:3.0:1787075978.764446:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787075978.764981:0:5837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1847800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5837:1873884700809216:192.168.204.50@tcp:105: 00010000:00010000:2.0:1787075978.765011:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075978.765056:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2361:x1873884678783744:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6348us (10483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075978.765067:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:1.0:1787075978.861288:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075978.861391:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678784256 00000100:00100000:3.0:1787075978.861401:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678784256 00000100:00100000:3.0:1787075978.861479:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 144 00000100:00100000:3.0:1787075978.861489:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+19:11355:x1873884678784256:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787075978.861514:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075978.861536:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fece lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762360f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075978.862284:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787075978.863215:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fece lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762360f expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.863233:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ae00) 00010000:00010000:3.0:1787075978.863236:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787075978.863241:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869fece lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762360f expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075978.863255:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523a00, rc 0) 00000100:00100000:3.0:1787075978.863448:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+20:11355:x1873884678784256:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1960us (2171us total) trans 4294967420 rc 301/301 00000100:00100000:3.0:1787075978.863456:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 144 00000100:00100000:0.0:1787075978.882224:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075978.882389:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678784512 00000100:00100000:3.0:1787075978.882399:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678784512 00000100:00100000:3.0:1787075978.882455:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:3.0:1787075978.882465:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+20:11355:x1873884678784512:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1787075978.883269:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+21:11355:x1873884678784512:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 802us (1051us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1787075978.883280:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:0.0:1787075979.025751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075979.025884:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678784640 00000100:00100000:2.0:1787075979.025905:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678784640 00000100:00100000:2.0:1787075979.026002:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 145 00000100:00100000:2.0:1787075979.026014:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+21:11361:x1873884678784640:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787075979.026043:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075979.026067:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad6869fedc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623616 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.026142:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad6869fee3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.026159:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad6869fee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.026173:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad6869fee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075979.026246:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787075979.026250:0:7654:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787075979.026296:0:7654:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad6869fee3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.026322:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad6869fedc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623616 expref: 23 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.026356:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad6869fee3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623616 expref: 22 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.026504:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:2.0:1787075979.026508:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787075979.026511:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1840c00, rc 0) 00000100:00100000:2.0:1787075979.026596:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+22:11361:x1873884678784640:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 574us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075979.026604:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 145 00000100:00100000:1.0:1787075979.035858:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075979.035992:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678784896 00000100:00100000:2.0:1787075979.036010:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678784896 00000100:00100000:2.0:1787075979.036097:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 146 00000100:00100000:2.0:1787075979.036117:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+22:11361:x1873884678784896:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787075979.036145:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075979.036172:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad6869feea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762361d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.036282:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad6869fef1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.036297:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad6869fef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.036308:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad6869fef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075979.036337:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787075979.036491:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad6869feea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762361d expref: 25 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.036510:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad6869fef1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762361d expref: 24 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.036518:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99619211cb00) 00010000:00010000:2.0:1787075979.036520:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787075979.036524:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1841400, rc 0) 00000100:00100000:2.0:1787075979.036614:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+24:11361:x1873884678784896:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 503us (773us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787075979.036622:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 146 00000100:00100000:0.0:1787075979.043550:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075979.043715:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075979.043916:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678785280 00000100:00100000:1.0:1787075979.043930:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678785280 00000100:00100000:1.0:1787075979.044009:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 147 00000100:00100000:1.0:1787075979.044020:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+24:11361:x1873884678785280:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787075979.044053:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075979.044081:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869feff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623624 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.044327:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869ff06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.044357:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869ff06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.044371:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869ff06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075979.044384:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787075979.044540:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad6869feff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623624 expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.044561:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869ff06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623624 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.044571:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99619211cb00) 00010000:00010000:1.0:1787075979.044574:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787075979.044578:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632a00, rc 0) 00000100:00100000:1.0:1787075979.044696:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+26:11361:x1873884678785280:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 677us (981us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1787075979.044728:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 147 00000100:00100000:2.0:1787075979.047869:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678785024 00000100:00100000:2.0:1787075979.047891:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678785024 00000100:00100000:2.0:1787075979.048009:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:2.0:1787075979.048020:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+26:2362:x1873884678785024:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075979.048041:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075979.048074:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad6869fef1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762361d expref: 26 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.048098:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99619211cb00) 00010000:00010000:2.0:1787075979.048103:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075979.048182:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+25:2362:x1873884678785024:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 164us (4648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075979.048191:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:2.0:1787075979.053832:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075979.054340:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678785408 00000100:00100000:3.0:1787075979.054379:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678785408 00000100:00100000:3.0:1787075979.054479:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:3.0:1787075979.054492:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2359:x1873884678785408:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1787075979.054560:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869ff14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.054589:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce31b2d8/0x859911ad6869fec7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623608 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.054598:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787075979.054604:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787075979.054609:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869ff14 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.054692:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce31b2d8/0x859911ad6869fec7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623608 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.054710:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce31b2d8/0x859911ad6869fec7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623608 expref: 6 pid: 6706 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075979.054727:0:6704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf69c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1873884700809344:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787075979.054865:0:6704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62ee40 going to sleep for 11 seconds 00000100:00080000:2.0:1787075979.055181:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787075979.061197:0:6704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf69c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1873884700809344:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787075979.061263:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869ff14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075979.067796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075979.072897:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678785536 00000100:00100000:0.0:1787075979.072913:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678785536 00002000:00100000:0.0:1787075979.072978:0:6709:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9961bf69c000 x1873884678785536/t0(0) o4->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:50/0 lens 504/0 e 0 to 0 dl 1787075990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787075979.072990:0:6709:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961bf69c000 with x1873884678785536 ext(0->12) 00010000:00010000:0.0:1787075979.073002:0:6709:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ce31b2d8/0x859911ad6869fec7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623608 expref: 7 pid: 6706 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.073041:0:6709:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ce31b2d8/0x859911ad6869fec7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623608 expref: 7 pid: 6706 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787075979.073050:0:6709:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9961bf69c000 00000100:00100000:0.0:1787075979.073076:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:0.0:1787075979.073085:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2361:x1873884678785536:12345-192.168.204.50@tcp:4:lfs.0 00000100:00100000:0.0:1787075979.075296:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:2361:x1873884678785536:12345-192.168.204.50@tcp:4:lfs.0 Request processed in 2196us (7498us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787075979.075313:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00002000:00100000:0.0:1787075979.075326:0:6709:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9961bf69c000 x1873884678785536/t4294967305(0) o4->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:50/0 lens 504/448 e 0 to 0 dl 1787075990 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787075979.075849:0:6709:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961bf69c000 with x1873884678785536 ext(0->12) 00010000:00010000:0.0:1787075979.075867:0:6709:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ce31b2d8/0x859911ad6869fec7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623608 expref: 9 pid: 6706 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.075891:0:6709:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ce31b2d8/0x859911ad6869fec7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623608 expref: 9 pid: 6706 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787075979.075901:0:6709:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9961bf69c000 00000100:00100000:2.0:1787075979.089255:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075979.089364:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678785664 00000100:00100000:1.0:1787075979.089376:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678785664 00010000:00010000:1.0:1787075979.089423:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce31b2d8/0x859911ad6869fec7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623608 expref: 9 pid: 6706 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075979.089467:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:1.0:1787075979.089477:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:2359:x1873884678785664:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787075979.089493:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787075979.089521:0:8465:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787075979.089524:0:8465:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787075979 00002000:00010000:1.0:1787075979.089526:0:8465:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787075979 00002000:00010000:1.0:1787075979.089529:0:8465:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787075979 00010000:00010000:1.0:1787075979.089536:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce31b2d8/0x859911ad6869fec7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623608 expref: 9 pid: 6706 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.089550:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce31b2d8/0x859911ad6869fec7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623608 expref: 9 pid: 6706 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.089575:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce31b2d8/0x859911ad6869fec7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623608 expref: 9 pid: 6706 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.089592:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787075979.089597:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787075979.089604:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869ff14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.089678:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869ff14 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.089709:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075979.089789:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2359:x1873884678785664:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 312us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075979.089797:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 61 00010000:00010000:3.0:1787075979.092691:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869ff14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.092713:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869ff14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.092779:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869ff14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.092789:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869ff14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.092798:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869ff14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.092805:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523a00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787075979.092809:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869ff14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.092818:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869ff14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.092838:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869ff14 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.092845:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba586150/0x859911ad6869ff14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075979.092955:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2359:x1873884678785408:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 38462us (39135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075979.092965:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:2.0:1787075979.097213:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075979.097454:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678785920 00000100:00100000:1.0:1787075979.097465:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678785920 00000100:00100000:1.0:1787075979.097526:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:1.0:1787075979.097536:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b0117850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+25:11361:x1873884678785920:12345-192.168.204.50@tcp:35:lfs.0 00000004:00010000:1.0:1787075979.097607:0:5855:0:(mdt_open.c:1970:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869ff06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623624 expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787075979.098176:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1787075979.098230:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1787075979.101124:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:1.0:1787075979.101244:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff1b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.101267:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad6869feb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235fa expref: 29 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.101287:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff1b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.101340:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad6869feb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235fa expref: 29 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.101859:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad6869feb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235fa expref: 29 pid: 7654 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075979.101875:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1873884700809472:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787075979.101980:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961900896c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787075979.104681:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1873884700809472:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075979.104711:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff1b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075979.105127:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075979.105435:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678786048 00000100:00100000:0.0:1787075979.105444:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678786048 00010000:00010000:0.0:1787075979.105485:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad6869feb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235fa expref: 30 pid: 7654 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075979.105568:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:0.0:1787075979.105590:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+30:2362:x1873884678786048:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075979.105614:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075979.105624:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad6869feb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235fa expref: 30 pid: 7654 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.105662:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad6869feb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235fa expref: 30 pid: 7654 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.105690:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad6869feb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235fa expref: 30 pid: 7654 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.105709:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99619211cb00) 00010000:00010000:0.0:1787075979.105716:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff1b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.105726:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.105732:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff1b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.105773:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075979.105834:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+29:2362:x1873884678786048:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 256us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075979.105841:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 62 00010000:00010000:1.0:1787075979.106052:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.106061:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787075979.106202:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:1.0:1787075979.106433:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1787075979.106549:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1873884700809600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787075979.106617:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075979.106683:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff996190089c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787075979.106685:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700809600 00000100:00100000:3.0:1787075979.106693:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700809600 00000100:00100000:3.0:1787075979.106747:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787075979.106766:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5855:x1873884700809600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787075979.106854:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5855:x1873884700809600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 100us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075979.106861:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787075979.106937:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787075979.107031:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f56a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1873884700809600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787075979.112851:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1787075979.112951:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b4d1c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1873884700809728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787075979.113023:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075979.113065:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff996190089840 going to sleep for 11 seconds 00000100:00100000:2.0:1787075979.113079:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700809728 00000100:00100000:2.0:1787075979.113087:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700809728 00000100:00100000:2.0:1787075979.113145:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787075979.113155:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1873884700809728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787075979.113369:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1873884700809728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 215us (344us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787075979.113377:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787075979.113835:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b4d1c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1873884700809728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787075979.113910:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1787075979.113953:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.113983:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff1b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.113991:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.113997:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075979.114002:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.114009:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff1b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.114026:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99619211cb00) 00010000:00010000:1.0:1787075979.114029:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787075979.114034:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff1b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.114040:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff1b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787075979.114240:0:5855:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787075979.114334:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1787075979.114357:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361089716706ns, next at 362089714276ns, rc = 0 00000001:00080000:1.0:1787075979.114364:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1787075979.114393:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99619211cb00) 00010000:00010000:1.0:1787075979.114396:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787075979.114403:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869ff06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623624 expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075979.114525:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b0117850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+32:11361:x1873884678785920:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 16990us (17326us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1787075979.114535:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00000020:00080000:1.0:1787075979.114541:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787075979.117299:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075979.117441:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678786176 00000100:00100000:3.0:1787075979.117452:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678786176 00000100:00100000:3.0:1787075979.117529:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 148 00000100:00100000:3.0:1787075979.117540:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+32:11361:x1873884678786176:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787075979.117572:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075979.117600:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869ff22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762362b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.117765:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869ff22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762362b expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.117782:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869ff22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762362b expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.117806:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:3.0:1787075979.117809:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787075979.117829:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523a00, rc 0) 00000100:00100000:3.0:1787075979.118023:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+33:11361:x1873884678786176:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 484us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075979.118031:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 148 00000100:00100000:2.0:1787075979.140826:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075979.141076:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678786432 00000100:00100000:0.0:1787075979.141087:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678786432 00000100:00100000:0.0:1787075979.141153:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:0.0:1787075979.141164:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+33:11361:x1873884678786432:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1787075979.141445:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+34:11361:x1873884678786432:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 282us (630us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1787075979.141454:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 39 00010000:00010000:1.0:1787075979.146504:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075979.237808:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075979.237888:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678786688 00000100:00100000:1.0:1787075979.237899:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678786688 00000100:00100000:1.0:1787075979.237975:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 149 00000100:00100000:1.0:1787075979.237987:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+34:11371:x1873884678786688:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787075979.238014:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075979.238036:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869ff29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623632 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075979.238161:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787075979.238291:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869ff29 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623632 expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.238306:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ae00) 00010000:00010000:1.0:1787075979.238309:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787075979.238314:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869ff29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623632 expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.238329:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632a00, rc 0) 00000100:00100000:1.0:1787075979.238404:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+35:11371:x1873884678786688:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 419us (604us total) trans 4294967434 rc 301/301 00000100:00100000:1.0:1787075979.238411:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 149 00000100:00100000:2.0:1787075979.240774:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075979.240890:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678786816 00000100:00100000:0.0:1787075979.240909:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678786816 00000100:00100000:0.0:1787075979.240986:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 150 00000100:00100000:0.0:1787075979.241000:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+35:11371:x1873884678786816:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:0.0:1787075979.241128:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69600/0x859911ad6869ff37 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241150:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69600/0x859911ad6869ff37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241165:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69600/0x859911ad6869ff37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241186:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869ff3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241193:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869ff3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241200:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869ff3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241343:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869ff45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241371:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869ff45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241380:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869ff45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787075979.241437:0:5853:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869ff45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241452:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69600/0x859911ad6869ff37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241460:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69600/0x859911ad6869ff37 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241467:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69600/0x859911ad6869ff37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241474:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075979.241479:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69600/0x859911ad6869ff37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241488:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69600/0x859911ad6869ff37 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241503:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:0.0:1787075979.241507:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075979.241513:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69600/0x859911ad6869ff37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241519:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69600/0x859911ad6869ff37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241545:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869ff3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241551:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869ff3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241557:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869ff3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241563:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075979.241566:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869ff3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241573:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869ff3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241581:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996191b7a400) 00010000:00010000:0.0:1787075979.241584:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075979.241587:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869ff3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241593:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869ff3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241610:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869ff45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241615:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869ff45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241620:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869ff45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241631:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075979.241635:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869ff45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241683:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869ff45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241693:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:0.0:1787075979.241695:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075979.241700:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869ff45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.241706:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869ff45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075979.241827:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+35:11371:x1873884678786816:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 828us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075979.241837:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 150 00000100:00100000:2.0:1787075979.248585:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075979.257534:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678787072 00000100:00100000:0.0:1787075979.257555:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678787072 00000100:00100000:0.0:1787075979.257680:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:0.0:1787075979.257694:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+35:11371:x1873884678787072:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1787075979.258091:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+36:11371:x1873884678787072:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 397us (9522us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787075979.258596:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:2.0:1787075979.307417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075979.307552:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678787328 00000100:00100000:1.0:1787075979.307568:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678787328 00000100:00100000:1.0:1787075979.307888:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 151 00000100:00100000:1.0:1787075979.308159:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+36:11374:x1873884678787328:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787075979.308195:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075979.308226:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869ff4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623639 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308345:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff53 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308365:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308381:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308402:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869ff5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308410:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869ff5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308417:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869ff5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308607:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869ff61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308617:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869ff61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308674:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869ff61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075979.308687:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787075979.308834:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308843:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff53 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308851:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308858:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075979.308863:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308872:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff53 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308888:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:1.0:1787075979.308900:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075979.308907:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308913:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ff53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308929:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869ff5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308936:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869ff5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308949:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869ff5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308955:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075979.308959:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869ff5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308966:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869ff5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308975:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996187c34b00) 00010000:00010000:1.0:1787075979.308977:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075979.308980:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869ff5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.308986:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad6869ff5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.309041:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad6869ff4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623639 expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.309056:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869ff61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623639 expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.309064:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:1.0:1787075979.309067:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787075979.309070:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632600, rc 0) 00000100:00100000:1.0:1787075979.309154:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+38:11374:x1873884678787328:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1000us (1754us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787075979.311965:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075979.312065:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678787456 00000100:00100000:2.0:1787075979.312079:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678787456 00000100:00100000:1.0:1787075979.318950:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 151 00000100:00100000:2.0:1787075979.322230:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 152 00000100:00100000:2.0:1787075979.322275:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+38:11374:x1873884678787456:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:2.0:1787075979.322398:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ff6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.322423:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ff6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.322461:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ff6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.322503:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ff6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.322511:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ff6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.322519:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ff6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.322526:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075979.322532:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ff6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.322541:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ff6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.322558:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:2.0:1787075979.322561:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787075979.322567:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ff6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.322574:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ff6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075979.322716:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+38:11374:x1873884678787456:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 464us (10767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075979.322725:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 152 00000100:00100000:2.0:1787075979.325866:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075979.325967:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678787712 00000100:00100000:1.0:1787075979.325981:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678787712 00000100:00100000:1.0:1787075979.326061:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:1.0:1787075979.326075:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+38:11374:x1873884678787712:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1787075979.326401:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+39:11374:x1873884678787712:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 328us (548us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787075979.326410:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:1.0:1787075979.705958:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075979.706083:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678787968 00000100:00100000:0.0:1787075979.706097:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678787968 00000100:00100000:0.0:1787075979.706173:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 153 00000100:00100000:0.0:1787075979.706204:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+39:11405:x1873884678787968:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1787075979.706239:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075979.706265:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869ff76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623640 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.706395:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869ff7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.706414:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869ff7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.706440:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869ff7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075979.706453:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787075979.706612:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad6869ff76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623640 expref: 42 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.706634:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869ff7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623640 expref: 41 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.706708:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:0.0:1787075979.706712:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787075979.706716:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe68a00, rc 0) 00000100:00100000:0.0:1787075979.706801:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+41:11405:x1873884678787968:12345-192.168.204.50@tcp:101:cat.0 Request processed in 599us (858us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787075979.706810:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 153 00000100:00100000:3.0:1787075979.724895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075979.724957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075979.725090:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678788096 00000100:00100000:1.0:1787075979.725105:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678788096 00000100:00100000:1.0:1787075979.725209:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:1.0:1787075979.725225:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a0261850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+41:2362:x1873884678788096:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787075979.725249:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075979.725287:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68a00/0x859911ad6869ff7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623640 expref: 41 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.725326:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:1.0:1787075979.725334:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075979.725415:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a0261850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+40:2362:x1873884678788096:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 194us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075979.725437:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:2.0:1787075979.730502:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678788352 00000100:00100000:2.0:1787075979.730531:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678788352 00000100:00100000:2.0:1787075979.730658:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:2.0:1787075979.730672:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+40:11405:x1873884678788352:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1787075979.731092:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+41:11405:x1873884678788352:12345-192.168.204.50@tcp:35:cat.0 Request processed in 422us (6133us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787075979.731102:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:1.0:1787075979.815857:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075979.816146:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678788608 00000100:00100000:2.0:1787075979.816161:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678788608 00000100:00100000:2.0:1787075979.816290:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 154 00000100:00100000:2.0:1787075979.816304:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+41:11411:x1873884678788608:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:2.0:1787075979.816355:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075979.816359:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787075979.816397:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad6869fee3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623616 expref: 41 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.816424:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:2.0:1787075979.816431:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787075979.816451:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad6869ff8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623647 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.816606:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad6869ff92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.816625:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869ff61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623639 expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.816636:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad6869ff92 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.816771:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869ff61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623639 expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.816790:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869ff61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623639 expref: 41 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075979.816807:0:5853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1844700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1873884700809856:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787075979.816952:0:5853:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616600 going to sleep for 11 seconds 00000100:00100000:1.0:1787075979.820582:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075979.820681:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678788736 00000100:00100000:0.0:1787075979.820695:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678788736 00010000:00010000:0.0:1787075979.820796:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869ff61 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623639 expref: 42 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075979.820849:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:0.0:1787075979.820862:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+42:2361:x1873884678788736:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075979.820903:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075979.820915:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869ff61 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623639 expref: 42 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.820931:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869ff61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623639 expref: 42 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.820962:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:0.0:1787075979.820968:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad6869ff92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.820978:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad6869ff92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.820987:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad6869ff92 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075979.821014:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075979.821145:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+42:2361:x1873884678788736:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 284us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075979.821155:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 63 00010000:00010000:2.0:1787075979.821447:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad6869ff61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623639 expref: 41 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075979.821469:0:5853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1844700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1873884700809856:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787075979.821496:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad6869ff92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.821506:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad6869ff92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.821511:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad6869ff92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075979.821535:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787075979.821783:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad6869ff8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623647 expref: 42 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.821801:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad6869ff92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623647 expref: 41 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075979.821826:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:2.0:1787075979.821830:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787075979.821832:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1840000, rc 0) 00000100:00100000:2.0:1787075979.821870:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+41:11411:x1873884678788608:12345-192.168.204.50@tcp:101:dd.0 Request processed in 5571us (6034us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1787075979.821983:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 154 00000100:00100000:0.0:1787075979.831055:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075979.831420:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678788992 00000100:00100000:1.0:1787075979.831456:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678788992 00000100:00100000:1.0:1787075979.831542:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 155 00000100:00100000:1.0:1787075979.831555:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+41:11411:x1873884678788992:12345-192.168.204.50@tcp:36:dd.0 00010000:00010000:1.0:1787075979.833117:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffa0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.833149:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075979.833163:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787075979.833225:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:1.0:1787075979.833262:0:7654:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000d30c5534 reply state 0000000021bc8b54 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075979.833273:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787075979.834123:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+44:11411:x1873884678788992:12345-192.168.204.50@tcp:36:dd.0 Request processed in 2561us (3076us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1787075979.834135:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 155 00000020:00080000:1.0:1787075979.834145:0:7654:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787075979.842037:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.842064:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffa0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.842073:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.842081:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075979.842088:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.842098:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffa0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.842121:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:3.0:1787075979.842125:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075979.842132:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffa0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075979.842140:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffa0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.168062:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075980.186795:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075980.187507:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678789120 00000100:00100000:1.0:1787075980.187527:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678789120 00000100:00080000:0.0:1787075980.187835:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787075980.188036:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 156 00000100:00100000:2.0:1787075980.188054:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+43:11425:x1873884678789120:12345-192.168.204.50@tcp:101:stat.0 00010000:00010000:2.0:1787075980.188095:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075980.188128:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad6869ffa7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762364e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.188240:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad6869ffae lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.188259:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad6869ffae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.188274:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad6869ffae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.188295:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad6869ffb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.188303:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad6869ffb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.188310:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad6869ffb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.188470:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ffbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.188484:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad6869ff92 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623647 expref: 44 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.188494:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ffbc lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.188543:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad6869ff92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623647 expref: 44 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.188562:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad6869ff92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623647 expref: 44 pid: 5853 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075980.188580:0:5853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1844700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1873884700809984:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787075980.189358:0:5853:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787075980.194021:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075980.194903:0:5853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1844700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1873884700809984:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787075980.194943:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ffbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075980.195199:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678789376 00000100:00100000:1.0:1787075980.195211:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678789376 00000100:00100000:1.0:1787075980.195292:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:1.0:1787075980.195304:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+45:5599:x1873884678789376:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787075980.196007:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+46:5599:x1873884678789376:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 701us (1999us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1787075980.196043:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:3.0:1787075980.200224:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075980.200677:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678789504 00000100:00100000:1.0:1787075980.200710:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678789504 00010000:00010000:1.0:1787075980.200779:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad6869ff92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623647 expref: 46 pid: 5853 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075980.200832:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:1.0:1787075980.200845:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+46:2361:x1873884678789504:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787075980.200871:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075980.200880:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad6869ff92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623647 expref: 46 pid: 5853 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.200899:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad6869ff92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623647 expref: 46 pid: 5853 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.200929:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad6869ff92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623647 expref: 46 pid: 5853 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.200952:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:1.0:1787075980.200960:0:8465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ffbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.200972:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ffbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.200980:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ffbc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.201167:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075980.201265:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+45:2361:x1873884678789504:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 421us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075980.201275:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 64 00010000:00010000:2.0:1787075980.204934:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ffbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.204958:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ffbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075980.205033:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787075980.205063:0:5853:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787075980.205099:0:5853:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ffbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.205118:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ffbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.205132:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad6869ffae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.205140:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad6869ffae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.205149:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad6869ffae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.205156:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075980.205161:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad6869ffae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.205170:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad6869ffae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.205188:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:2.0:1787075980.205192:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075980.205196:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad6869ffae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.205204:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad6869ffae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.205223:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad6869ffb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.205239:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad6869ffb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.205246:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad6869ffb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.205251:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075980.205255:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad6869ffb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.205261:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad6869ffb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.205271:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99619211c300) 00010000:00010000:2.0:1787075980.205273:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075980.205276:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad6869ffb5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.205283:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad6869ffb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.205345:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad6869ffa7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762364e expref: 45 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.205361:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ffbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762364e expref: 44 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.205369:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:2.0:1787075980.205372:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787075980.205382:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1840600, rc 0) 00000100:00100000:2.0:1787075980.205499:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+44:11425:x1873884678789120:12345-192.168.204.50@tcp:101:stat.0 Request processed in 17449us (18714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075980.205510:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 156 00000100:00100000:3.0:1787075980.278027:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075980.282867:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678789760 00000100:00100000:0.0:1787075980.282891:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678789760 00000100:00100000:0.0:1787075980.283006:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 157 00000100:00100000:0.0:1787075980.283019:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+44:11431:x1873884678789760:12345-192.168.204.50@tcp:36:truncate.0 00010000:00010000:0.0:1787075980.283106:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075980.283148:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad6869ffbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762364e expref: 44 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.283175:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:0.0:1787075980.283182:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787075980.283987:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869ffc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.284009:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869ffc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.284022:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869ffc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787075980.284092:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:0.0:1787075980.284118:0:5852:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000b49e716d reply state 00000000c9020474 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869ffc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075980.284129:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787075980.284292:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+46:11431:x1873884678789760:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 1273us (6492us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1787075980.284302:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 157 00000020:00080000:0.0:1787075980.284308:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787075980.288029:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869ffc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.288060:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869ffc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.288069:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869ffc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.288076:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68e00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075980.288084:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869ffc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.288094:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869ffc3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.288116:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:2.0:1787075980.288119:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075980.288124:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869ffc3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.288130:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad6869ffc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075980.446227:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075980.446781:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678789888 00000100:00100000:1.0:1787075980.446798:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678789888 00000100:00100000:1.0:1787075980.447511:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 158 00000100:00100000:1.0:1787075980.447525:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+45:11445:x1873884678789888:12345-192.168.204.50@tcp:101:stat.0 00010000:00010000:1.0:1787075980.447561:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075980.447591:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad6869ffca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623655 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.447764:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869ffd1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.447787:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869ffd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.447803:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869ffd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.447834:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869ffd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.447842:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869ffd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.447850:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869ffd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448521:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448534:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448543:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075980.448595:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787075980.448601:0:5854:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787075980.448628:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448670:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448681:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869ffd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448688:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869ffd1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448695:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869ffd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448702:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075980.448707:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869ffd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448715:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869ffd1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448754:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:1.0:1787075980.448758:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075980.448766:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869ffd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448773:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad6869ffd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448792:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869ffd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448799:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869ffd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448806:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869ffd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448812:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075980.448820:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869ffd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448827:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869ffd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448835:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996187c34b00) 00010000:00010000:1.0:1787075980.448837:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075980.448840:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869ffd8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448847:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad6869ffd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.448985:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad6869ffca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623655 expref: 47 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.449002:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623655 expref: 46 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.449011:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:1.0:1787075980.449013:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787075980.449017:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf633400, rc 0) 00000100:00100000:1.0:1787075980.452223:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+46:11445:x1873884678789888:12345-192.168.204.50@tcp:101:stat.0 Request processed in 4680us (6571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075980.452242:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 158 00000100:00100000:3.0:1787075980.539321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075980.539680:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678790144 00000100:00100000:0.0:1787075980.539717:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678790144 00000100:00100000:0.0:1787075980.539832:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 159 00000100:00100000:0.0:1787075980.539847:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+46:11455:x1873884678790144:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787075980.540160:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075980.540191:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869ffe6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762365c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075980.540370:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787075980.540536:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869ffe6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762365c expref: 48 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.540555:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ae00) 00010000:00010000:0.0:1787075980.540559:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787075980.540564:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869ffe6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762365c expref: 48 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.540584:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe69c00, rc 0) 00000100:00100000:0.0:1787075980.540762:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+47:11455:x1873884678790144:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 919us (1455us total) trans 4294967446 rc 301/301 00000100:00100000:0.0:1787075980.540772:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 159 00000100:00100000:2.0:1787075980.545041:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075980.545359:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678790400 00000100:00100000:1.0:1787075980.545372:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678790400 00000100:00100000:1.0:1787075980.545449:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:1.0:1787075980.545463:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b0116050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+47:11455:x1873884678790400:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1787075980.545931:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b0116050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+48:11455:x1873884678790400:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 469us (903us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1787075980.545941:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:2.0:1787075980.621468:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075980.623848:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678790656 00000100:00100000:0.0:1787075980.624022:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678790656 00000100:00100000:0.0:1787075980.624232:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 160 00000100:00100000:0.0:1787075980.624247:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+48:11461:x1873884678790656:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1787075980.624293:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075980.624341:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869fff4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623663 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.624535:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869fffb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.624555:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffdf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623655 expref: 49 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.624565:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869fffb lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.624618:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623655 expref: 49 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.624635:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffdf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623655 expref: 49 pid: 5854 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075980.624678:0:5853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1873884700810112:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787075980.624823:0:5853:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191860c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787075980.627565:0:5853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1873884700810112:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787075980.627609:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869fffb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075980.628842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075980.629360:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678790784 00000100:00100000:0.0:1787075980.629372:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678790784 00010000:00010000:0.0:1787075980.629428:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffdf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623655 expref: 50 pid: 5854 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075980.629479:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:0.0:1787075980.629507:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+50:2361:x1873884678790784:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075980.629526:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075980.629534:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffdf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623655 expref: 50 pid: 5854 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.629549:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623655 expref: 50 pid: 5854 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.629578:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad6869ffdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623655 expref: 50 pid: 5854 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.629599:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:0.0:1787075980.629605:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869fffb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.629616:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869fffb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.629624:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869fffb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.629735:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075980.629807:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+49:2361:x1873884678790784:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 300us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075980.629815:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 65 00010000:00010000:0.0:1787075980.629849:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869fffb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.629858:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869fffb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075980.631191:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787075980.631669:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad6869fff4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623663 expref: 50 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.631697:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869fffb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623663 expref: 49 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.631707:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:0.0:1787075980.631711:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787075980.631715:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe68800, rc 0) 00000100:00100000:0.0:1787075980.631857:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+49:11461:x1873884678790656:12345-192.168.204.50@tcp:101:bash.0 Request processed in 7612us (10403us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1787075980.631876:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 160 00000100:00100000:2.0:1787075980.635156:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075980.635288:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678791040 00000100:00100000:1.0:1787075980.635301:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678791040 00000100:00100000:1.0:1787075980.635427:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 161 00000100:00100000:1.0:1787075980.635441:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+49:11461:x1873884678791040:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:1.0:1787075980.635989:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a0009 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.636030:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a0009 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.636047:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a0009 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787075980.636114:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:1.0:1787075980.636142:0:7654:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000f8b74db9 reply state 000000008aa85011 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a0009 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075980.636153:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787075980.636275:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:11461:x1873884678791040:12345-192.168.204.50@tcp:36:bash.0 Request processed in 836us (1133us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787075980.636285:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 161 00000020:00080000:1.0:1787075980.636291:0:7654:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787075980.640603:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a0009 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.640628:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a0009 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.640637:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a0009 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.640677:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075980.640683:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a0009 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.640691:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a0009 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.640714:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:2.0:1787075980.640717:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075980.640734:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a0009 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075980.640741:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a0009 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075980.641232:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075980.641466:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678791168 00000100:00100000:1.0:1787075980.641481:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678791168 00000100:00100000:1.0:1787075980.641552:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 162 00000100:00100000:1.0:1787075980.641564:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+51:11461:x1873884678791168:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1787075980.641598:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075980.641622:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0010 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762366a expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.641769:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0017 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.641786:0:7654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869fffb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623663 expref: 52 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.641819:0:7654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0017 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.641861:0:7654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869fffb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623663 expref: 52 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.642104:0:7654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869fffb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623663 expref: 52 pid: 5853 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075980.642123:0:7654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b4d1c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1873884700810240:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787075980.642274:0:7654:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961900896c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787075980.644869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075980.645170:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678791296 00000100:00100000:0.0:1787075980.645182:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678791296 00010000:00010000:0.0:1787075980.645238:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869fffb lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623663 expref: 53 pid: 5853 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075980.645302:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00100000:0.0:1787075980.645315:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+53:2362:x1873884678791296:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075980.645334:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075980.645342:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869fffb lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623663 expref: 53 pid: 5853 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.645358:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869fffb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623663 expref: 53 pid: 5853 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.645415:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:0.0:1787075980.645422:0:8465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0017 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.645434:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.645443:0:8465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0017 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.645470:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad6869fffb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623663 expref: 53 pid: 5853 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.645478:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075980.645489:0:7654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b4d1c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1873884700810240:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787075980.645514:0:7654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.645523:0:7654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.645529:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075980.645543:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:2362:x1873884678791296:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 232us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075980.645551:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 66 00000004:00200000:1.0:1787075980.645589:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787075980.645595:0:7654:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787075980.646446:0:7654:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.646514:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0010 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762366a expref: 52 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.646536:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762366a expref: 51 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.646544:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:1.0:1787075980.646547:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787075980.646550:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632c00, rc 0) 00000100:00100000:1.0:1787075980.646668:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+51:11461:x1873884678791168:12345-192.168.204.50@tcp:101:bash.0 Request processed in 5106us (5442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075980.646679:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 162 00000100:00100000:0.0:1787075980.652066:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075980.652181:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678791552 00000100:00100000:1.0:1787075980.652197:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678791552 00000100:00100000:1.0:1787075980.652365:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:1.0:1787075980.652380:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+51:11461:x1873884678791552:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:1.0:1787075980.652992:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:11461:x1873884678791552:12345-192.168.204.50@tcp:35:bash.0 Request processed in 534us (860us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1787075980.653004:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:2.0:1787075980.736750:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075980.737080:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678791808 00000100:00100000:0.0:1787075980.737094:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678791808 00000100:00100000:0.0:1787075980.737221:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 163 00000100:00100000:0.0:1787075980.737236:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:11471:x1873884678791808:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787075980.737289:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075980.737326:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a001e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623671 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075980.737520:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787075980.737738:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a001e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623671 expref: 54 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.737757:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ae00) 00010000:00010000:0.0:1787075980.737903:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787075980.738031:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a001e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623671 expref: 54 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.738053:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe69c00, rc 0) 00000100:00100000:0.0:1787075980.738156:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+53:11471:x1873884678791808:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 923us (1436us total) trans 4294967452 rc 301/301 00000100:00100000:0.0:1787075980.738166:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 163 00000100:00100000:2.0:1787075980.741242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075980.741554:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678791936 00000100:00100000:3.0:1787075980.741567:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678791936 00000100:00100000:3.0:1787075980.741730:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 164 00000100:00100000:3.0:1787075980.741744:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+53:11471:x1873884678791936:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:3.0:1787075980.741858:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a002c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.741892:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a002c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.741907:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a002c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.741937:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a0033 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.741945:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a0033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.741952:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a0033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742085:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a003a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742095:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a003a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742103:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a003a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787075980.742177:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a003a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742193:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a002c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742201:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a002c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742209:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a002c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742217:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075980.742222:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a002c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742231:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a002c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742246:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:3.0:1787075980.742249:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075980.742267:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a002c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742275:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a002c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742291:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a0033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742298:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a0033 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742310:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a0033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742315:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075980.742317:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a0033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742323:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a0033 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742331:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996194304e00) 00010000:00010000:3.0:1787075980.742333:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075980.742336:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a0033 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742343:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a0033 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742378:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a003a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742386:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a003a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742392:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a003a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742397:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075980.742412:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a003a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742431:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a003a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742440:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:3.0:1787075980.742442:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075980.742445:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a003a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.742958:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a003a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075980.743071:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+53:11471:x1873884678791936:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 1326us (1840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075980.743082:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 164 00000100:00100000:0.0:1787075980.753561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075980.753822:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678792192 00000100:00100000:2.0:1787075980.753837:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678792192 00000100:00100000:2.0:1787075980.753932:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:2.0:1787075980.753944:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+53:11471:x1873884678792192:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1787075980.754353:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+54:11471:x1873884678792192:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 409us (806us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787075980.754362:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:2.0:1787075980.795136:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075980.796003:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678792448 00000100:00100000:3.0:1787075980.796018:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678792448 00000100:00100000:3.0:1787075980.796171:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 165 00000100:00100000:3.0:1787075980.796185:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+54:11474:x1873884678792448:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787075980.796231:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075980.796275:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0041 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623678 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.796413:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0048 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.796434:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0048 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.796448:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0048 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.796618:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a004f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.796627:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a004f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.796634:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a004f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.797601:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0056 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.797616:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.797626:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075980.797684:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787075980.798624:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0048 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.798679:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0048 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.798687:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0048 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.798695:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075980.798701:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0048 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.798742:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0048 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.798769:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:3.0:1787075980.798773:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075980.798780:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0048 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.798787:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0048 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.798808:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a004f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.798814:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a004f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.798821:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a004f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.798826:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075980.798829:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a004f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.798835:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a004f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.798844:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996194304e00) 00010000:00010000:3.0:1787075980.798847:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075980.798850:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a004f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.798870:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a004f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.798965:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0041 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623678 expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.798983:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623678 expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075980.798991:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:3.0:1787075980.798993:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787075980.798996:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523000, rc 0) 00000100:00100000:3.0:1787075980.799094:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+56:11474:x1873884678792448:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2912us (3975us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787075980.799105:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 165 00000100:00100000:3.0:1787075980.807355:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075980.807574:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075980.809010:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678792576 00000100:00100000:0.0:1787075980.809030:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678792576 00000100:00100000:0.0:1787075980.809133:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:0.0:1787075980.809147:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf69ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+56:2359:x1873884678792576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075980.809171:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075980.809209:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0056 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623678 expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075980.809238:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:0.0:1787075980.809244:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075980.809332:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf69ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:2359:x1873884678792576:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 188us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075980.809342:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:1.0:1787075980.814999:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678792704 00000100:00100000:1.0:1787075980.815021:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678792704 00000100:00100000:1.0:1787075980.816358:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 166 00000100:00100000:1.0:1787075980.816384:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:11474:x1873884678792704:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:1.0:1787075980.816569:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0064 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.816617:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.816632:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.816684:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0064 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.816694:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0064 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.816701:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0064 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.816709:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075980.816714:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0064 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.816732:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0064 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.816746:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:1.0:1787075980.816750:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787075980.816754:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0064 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.816902:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0064 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075980.817158:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:11474:x1873884678792704:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 783us (9581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075980.817178:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 166 00000100:00100000:2.0:1787075980.823093:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075980.823184:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678792960 00000100:00100000:0.0:1787075980.823198:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678792960 00000100:00100000:0.0:1787075980.823412:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:0.0:1787075980.823427:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:11474:x1873884678792960:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1787075980.824133:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+56:11474:x1873884678792960:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 706us (1054us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787075980.824161:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:0.0:1787075980.998402:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075980.999061:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678793216 00000100:00100000:1.0:1787075980.999077:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678793216 00000100:00100000:1.0:1787075980.999464:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 167 00000100:00100000:1.0:1787075980.999479:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+56:11492:x1873884678793216:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1787075980.999514:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075980.999544:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a006b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762367f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.999757:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad686a0072 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.999777:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad686a0072 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075980.999791:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad686a0072 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075980.999807:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787075981.001485:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a006b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762367f expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.001525:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad686a0072 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762367f expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.001537:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:1.0:1787075981.001540:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787075981.001544:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632600, rc 0) 00000100:00100000:1.0:1787075981.001703:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+58:11492:x1873884678793216:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2228us (3315us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1787075981.001723:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 167 00000100:00100000:3.0:1787075981.027863:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075981.027920:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678793344 00000100:00100000:3.0:1787075981.027934:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678793344 00000100:00100000:3.0:1787075981.028016:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 168 00000100:00100000:3.0:1787075981.028028:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+58:11493:x1873884678793344:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787075981.028066:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075981.028095:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0080 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623686 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.028198:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a0087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.028238:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a0087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.028271:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a0087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075981.029631:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787075981.029656:0:5854:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787075981.029702:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a0087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.029762:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0080 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623686 expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.029794:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a0087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623686 expref: 59 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.029805:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:3.0:1787075981.029809:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787075981.029814:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523400, rc 0) 00000100:00100000:3.0:1787075981.029929:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+59:11493:x1873884678793344:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1902us (2083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075981.029942:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 168 00000100:00100000:0.0:1787075981.038898:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075981.038946:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678793728 00000100:00100000:0.0:1787075981.038970:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678793728 00000100:00100000:0.0:1787075981.039049:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:0.0:1787075981.039062:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+59:11493:x1873884678793728:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1787075981.042154:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:11493:x1873884678793728:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 3075us (3250us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1787075981.042174:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:0.0:1787075981.049174:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075981.049232:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678793856 00000100:00100000:1.0:1787075981.049246:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678793856 00000100:00100000:1.0:1787075981.049339:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:1.0:1787075981.049351:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:11493:x1873884678793856:12345-192.168.204.50@tcp:103:lfs.0 00010000:00010000:1.0:1787075981.049387:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787075981.049420:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0017 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762366a expref: 60 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.049449:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad686a0072 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762367f expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.049462:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad6869ff22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762362b expref: 58 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.049473:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304d00) 00010000:00010000:1.0:1787075981.049506:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075981.049579:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+57:11493:x1873884678793856:12345-192.168.204.50@tcp:103:lfs.0 Request processed in 230us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075981.049587:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:1.0:1787075981.062620:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075981.065058:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678793984 00000100:00100000:3.0:1787075981.065083:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678793984 00000100:00100000:3.0:1787075981.065177:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 169 00000100:00100000:3.0:1787075981.065188:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+57:11493:x1873884678793984:12345-192.168.204.50@tcp:58:lfs.0 00010000:00010000:3.0:1787075981.065361:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a008e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.065392:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a008e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.065407:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a008e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787075981.065679:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787075981.065818:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+57:11493:x1873884678793984:12345-192.168.204.50@tcp:58:lfs.0 Request processed in 630us (3212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075981.065827:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 169 00000100:00100000:3.0:1787075981.109492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075981.109545:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678794112 00000100:00100000:3.0:1787075981.109558:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678794112 00000100:00100000:3.0:1787075981.109625:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 170 00000100:00100000:3.0:1787075981.109661:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+57:11495:x1873884678794112:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787075981.109691:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075981.109731:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0095 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762368d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.109820:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a009c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.109836:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a009c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.109848:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a009c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.109864:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.109892:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.109899:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110023:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a00aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110031:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a00aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110039:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a00aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075981.110093:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787075981.110099:0:5854:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787075981.110130:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a00aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110146:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a00aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110155:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a009c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110163:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a009c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110170:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a009c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110187:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075981.110192:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a009c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110201:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a009c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110218:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:3.0:1787075981.110222:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075981.110228:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a009c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110234:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a009c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110253:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110260:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110265:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110270:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075981.110273:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110279:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110297:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996194304500) 00010000:00010000:3.0:1787075981.110299:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075981.110302:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110309:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110371:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0095 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762368d expref: 59 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110385:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a00aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762368d expref: 58 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.110393:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304e00) 00010000:00010000:3.0:1787075981.110396:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787075981.110399:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523a00, rc 0) 00000100:00100000:3.0:1787075981.110496:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+58:11495:x1873884678794112:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 860us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075981.110506:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 170 00000001:00080000:0.0:1787075981.144995:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1787075981.145027:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00010000:00010000:1.0:1787075981.197295:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787075981.525314:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787075981.525328:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787075981.525402:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787075981.525412:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787075981.525597:0:11694:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1873884700810368:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787075981.525785:0:11694:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616000 going to sleep for 11 seconds 00000100:00100000:0.0:1787075981.548188:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075981.550051:0:11694:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1873884700810368:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787075981.550272:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678794240 00000100:00100000:3.0:1787075981.550280:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678794240 00000100:00100000:3.0:1787075981.550357:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 171 00000100:00100000:3.0:1787075981.550367:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfc36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+58:11506:x1873884678794240:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787075981.550412:0:5853:0:(mdt_handler.c:8026:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787075981.550574:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfc36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+58:11506:x1873884678794240:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 206us (2403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075981.550582:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 171 00000100:00100000:0.0:1787075981.557728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075981.560183:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678794368 00000100:00100000:3.0:1787075981.560204:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678794368 00000100:00100000:3.0:1787075981.561668:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 172 00000100:00100000:3.0:1787075981.561692:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+58:11506:x1873884678794368:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787075981.561802:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00b1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.561821:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.561833:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.561942:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00b8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.561952:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.561958:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.561985:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a00bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562000:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a00bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562008:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a00bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075981.562068:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787075981.562073:0:5854:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787075981.562211:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a00bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562225:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562231:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00b1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562239:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00b1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562245:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075981.562249:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00b1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562256:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00b1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562269:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996191b79600) 00010000:00010000:3.0:1787075981.562271:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075981.562275:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562281:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562294:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562309:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00b8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562315:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562320:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075981.562323:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562330:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00b8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562336:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff996194304500) 00010000:00010000:3.0:1787075981.562339:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075981.562341:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00b8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562348:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00b8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562373:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a00bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562377:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a00bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562383:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a00bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562388:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075981.562396:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a00bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562403:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a00bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562411:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304e00) 00010000:00010000:3.0:1787075981.562413:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075981.562416:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a00bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.562421:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a00bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075981.562593:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+58:11506:x1873884678794368:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 Request processed in 910us (4956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075981.562604:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 172 00000100:00100000:0.0:1787075981.570187:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075981.570236:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678794624 00000100:00100000:0.0:1787075981.570247:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678794624 00000100:00100000:0.0:1787075981.570306:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 173 00000100:00100000:0.0:1787075981.570319:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+58:11506:x1873884678794624:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787075981.570347:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075981.570375:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad686a00c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623694 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.571627:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad686a00cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.571690:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad686a00cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.571715:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad686a00cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075981.571732:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787075981.572357:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad686a00cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.572369:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad686a00cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.572378:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad686a00cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.572385:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68e00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075981.572390:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad686a00cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.572400:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad686a00cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.572420:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304e00) 00010000:00010000:0.0:1787075981.572425:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787075981.572431:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad686a00cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.572439:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68e00/0x859911ad686a00cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.572759:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad686a00c6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623694 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.572783:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996191b79600) 00010000:00010000:0.0:1787075981.572786:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787075981.572791:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad686a00c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623694 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.572802:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe68800, rc 0) 00000100:00100000:0.0:1787075981.573682:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+59:11506:x1873884678794624:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 3360us (3502us total) trans 4294967458 rc 301/301 00000100:00100000:0.0:1787075981.573695:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 173 00000100:00100000:1.0:1787075981.582816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075981.583758:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678794752 00000100:00100000:3.0:1787075981.583777:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678794752 00000100:00100000:3.0:1787075981.583888:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 174 00000100:00100000:3.0:1787075981.583900:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+59:11506:x1873884678794752:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787075981.583953:0:7654:0:(mdt_handler.c:8026:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787075981.584120:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+59:11506:x1873884678794752:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 221us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075981.584129:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 174 00000100:00100000:1.0:1787075981.591748:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075981.592938:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678795008 00000100:00100000:3.0:1787075981.592957:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678795008 00000100:00100000:3.0:1787075981.593062:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 175 00000100:00100000:3.0:1787075981.593075:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+59:11506:x1873884678795008:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787075981.593127:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075981.593132:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787075981.593174:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a0087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623686 expref: 59 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.593203:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:3.0:1787075981.593210:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787075981.593228:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a00db lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762369b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787075981.594320:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787075981.597238:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.597270:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.597286:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.597391:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a00db lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762369b expref: 61 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.597416:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762369b expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.599067:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996194304500) 00010000:00010000:3.0:1787075981.599074:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787075981.599105:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523600, rc 0) 00000100:00100000:3.0:1787075981.599224:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:11506:x1873884678795008:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 6145us (7485us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1787075981.599236:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 175 00000100:00100000:2.0:1787075981.605869:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075981.606054:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678795264 00000100:00100000:3.0:1787075981.606074:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678795264 00000100:00100000:3.0:1787075981.606749:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 176 00000100:00100000:3.0:1787075981.606764:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:11506:x1873884678795264:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787075981.606837:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075981.606880:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a00e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762369b expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.606904:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996194304500) 00010000:00010000:3.0:1787075981.606935:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787075981.606970:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.606985:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.606995:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.607060:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a00f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1c19c5ad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.607068:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a00f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1c19c5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.607075:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a00f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1c19c5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.607243:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.607250:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00f0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.607256:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.607262:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075981.607266:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.607273:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.607287:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:3.0:1787075981.607290:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075981.607297:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.607303:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a00f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.607313:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a00f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1c19c5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.607319:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a00f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1c19c5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.607324:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a00f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1c19c5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.607336:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075981.607339:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a00f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1c19c5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.607344:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a00f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1c19c5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.607351:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1c19c5ad (ffff996194304700) 00010000:00010000:3.0:1787075981.607353:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075981.607356:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a00f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1c19c5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.607361:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a00f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1c19c5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075981.608997:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+59:11506:x1873884678795264:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 2227us (3136us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787075981.614225:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 176 00000100:00100000:0.0:1787075981.619807:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075981.619921:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678795392 00000100:00100000:3.0:1787075981.619933:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678795392 00000100:00100000:3.0:1787075981.619987:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 177 00000100:00100000:3.0:1787075981.619997:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+59:11506:x1873884678795392:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787075981.620021:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075981.620045:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a00fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76236a2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.620093:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0105 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.620123:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.620135:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.620232:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a00fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236a2 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.620249:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0105 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236a2 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.620257:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996194304800) 00010000:00010000:3.0:1787075981.620260:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787075981.620263:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522c00, rc 0) 00000100:00100000:3.0:1787075981.620323:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:11506:x1873884678795392:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 326us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075981.620329:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 177 00000100:00100000:0.0:1787075981.627876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075981.628190:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678795648 00000100:00100000:2.0:1787075981.628279:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678795648 00000100:00100000:2.0:1787075981.628534:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 178 00000100:00100000:2.0:1787075981.628550:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:11506:x1873884678795648:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787075981.628719:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a010c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.628746:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a010c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.628763:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a010c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787075981.629204:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1787075981.629234:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363604592093ns, next at 364604588288ns, rc = 0 00000004:00010000:2.0:1787075981.629392:0:5854:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 000000004a8ecc93 reply state 00000000cba9c11c transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a010c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075981.629421:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787075981.629589:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+62:11506:x1873884678795648:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 1042us (1721us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1787075981.629598:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 178 00010000:00010000:3.0:1787075981.635156:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a010c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.635192:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a010c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.635201:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a010c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.635209:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840800 already unused, calling callback (ffffffffc1fcf4f0) 00000100:00100000:2.0:1787075981.635219:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075981.635580:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678795776 00000100:00100000:1.0:1787075981.635597:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678795776 00000100:00100000:1.0:1787075981.635687:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 179 00000100:00100000:1.0:1787075981.635700:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+62:11506:x1873884678795776:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787075981.635743:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075981.635768:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a0113 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76236a9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.635844:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a0113 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236a9 expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.635861:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a0113 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236a9 expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.635883:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996194304800) 00010000:00010000:1.0:1787075981.635886:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787075981.635890:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632e00, rc 0) 00000100:00100000:1.0:1787075981.635953:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+63:11506:x1873884678795776:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 256us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075981.635960:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 179 00010000:00010000:3.0:1787075981.637338:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a010c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.637379:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a010c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.637416:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996194304800) 00010000:00010000:3.0:1787075981.637419:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787075981.637426:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a010c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.637444:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a010c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075981.646772:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075981.646910:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678795904 00000100:00100000:1.0:1787075981.646922:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678795904 00000100:00100000:1.0:1787075981.647012:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:1.0:1787075981.647023:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2361:x1873884678795904:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787075981.648600:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787075981.649244:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2361:x1873884678795904:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 2215us (2477us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787075981.649258:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:0.0:1787075981.658437:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075981.658523:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678796160 00000100:00100000:2.0:1787075981.658534:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678796160 00000100:00100000:2.0:1787075981.658592:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:2.0:1787075981.658601:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+62:11506:x1873884678796160:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787075981.658855:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+63:11506:x1873884678796160:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 255us (429us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787075981.658864:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:3.0:1787075981.665988:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075981.666110:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678796416 00000100:00100000:0.0:1787075981.666127:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678796416 00000100:00100000:0.0:1787075981.666265:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 180 00000100:00100000:0.0:1787075981.666278:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+63:11506:x1873884678796416:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787075981.666474:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+63:11506:x1873884678796416:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 198us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075981.666484:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 180 00000100:00100000:0.0:1787075981.678821:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075981.678958:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678796544 00000100:00100000:3.0:1787075981.678974:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678796544 00000100:00100000:3.0:1787075981.679072:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 181 00000100:00100000:3.0:1787075981.679086:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+63:11506:x1873884678796544:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787075981.679117:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075981.679149:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a011a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76236b0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.679423:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0121 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.679515:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.679533:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075981.679754:0:5852:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787075981.679811:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.679854:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a011a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236b0 expref: 65 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.679875:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236b0 expref: 64 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.679885:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996194304800) 00010000:00010000:3.0:1787075981.679888:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787075981.679893:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523000, rc 0) 00000100:00100000:3.0:1787075981.679985:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+64:11506:x1873884678796544:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 900us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075981.679996:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 181 00000100:00100000:2.0:1787075981.686076:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075981.686416:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678796672 00000100:00100000:1.0:1787075981.686439:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678796672 00000100:00100000:1.0:1787075981.686508:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:1.0:1787075981.686519:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2360:x1873884678796672:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787075981.686539:0:8477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075981.686560:0:8477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000011e6bb6/0x859911ad686a0128 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76236b7 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787075981.686588:0:8477:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a849d8d, blocks: 0x1 00010000:00010000:1.0:1787075981.686611:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=363s v=(0 0) 00010000:00010000:1.0:1787075981.686616:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787075981.686627:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000011e6bb6/0x859911ad686a0128 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236b7 expref: 8 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.687439:0:8477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000011e6bb6/0x859911ad686a0128 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236b7 expref: 8 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.687458:0:8477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632000, rc 0) 00000100:00100000:1.0:1787075981.687525:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2360:x1873884678796672:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1007us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075981.687533:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:3.0:1787075981.713945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075981.714508:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678796928 00000100:00100000:0.0:1787075981.714524:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678796928 00000100:00100000:0.0:1787075981.714597:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 182 00000100:00100000:0.0:1787075981.714618:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+64:11506:x1873884678796928:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787075981.715015:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+64:11506:x1873884678796928:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 398us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075981.715024:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 182 00000100:00100000:0.0:1787075981.723819:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075981.723922:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678797056 00000100:00100000:3.0:1787075981.723941:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678797056 00000100:00100000:3.0:1787075981.724028:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:3.0:1787075981.724056:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:11506:x1873884678797056:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787075981.724085:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075981.724113:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a012f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76236be expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.724159:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000011e6bb6/0x859911ad686a0128 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236b7 expref: 9 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.724170:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787075981.724191:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787075981.724197:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a012f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236be expref: 9 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.724262:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000011e6bb6/0x859911ad686a0128 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236b7 expref: 9 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075981.724278:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000011e6bb6/0x859911ad686a0128 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236b7 expref: 9 pid: 8477 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075981.724297:0:6706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1873884700810496:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787075981.724457:0:6706:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075981.734719:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1873884700810496:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787075981.734760:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a012f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236be expref: 9 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.734780:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523800, rc 0) 00000100:00100000:0.0:1787075981.734861:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:11506:x1873884678797056:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 10823us (11053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075981.734871:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:0.0:1787075981.736039:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075981.736372:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678797184 00000100:00100000:1.0:1787075981.736387:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678797184 00010000:00010000:1.0:1787075981.736433:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000011e6bb6/0x859911ad686a0128 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236b7 expref: 9 pid: 8477 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075981.736480:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:1.0:1787075981.736491:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a0261450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:2362:x1873884678797184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787075981.736519:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075981.736548:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000011e6bb6/0x859911ad686a0128 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236b7 expref: 9 pid: 8477 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.736564:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000011e6bb6/0x859911ad686a0128 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236b7 expref: 9 pid: 8477 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.736591:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000011e6bb6/0x859911ad686a0128 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236b7 expref: 9 pid: 8477 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.736606:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787075981.736611:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787075981.736619:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a012f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236be expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.736630:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a012f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236be expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.736712:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a012f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236be expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075981.736729:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b4d1d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5836:1873884700810624:192.168.204.50@tcp:105: 00000100:00100000:1.0:1787075981.736834:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187940480 going to sleep for 11 seconds 00000100:00100000:2.0:1787075981.743621:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b4d1d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5836:1873884700810624:192.168.204.50@tcp:105: 00010000:00010000:2.0:1787075981.743688:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075981.743779:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a0261450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2362:x1873884678797184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 7288us (7752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075981.743791:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:1.0:1787075981.749782:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075981.749941:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678797312 00000100:00100000:2.0:1787075981.749952:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678797312 00002000:00100000:2.0:1787075981.750005:0:6711:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9961b4d1f800 x1873884678797312/t0(0) o4->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:52/0 lens 504/0 e 0 to 0 dl 1787075992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787075981.750016:0:6711:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961b4d1f800 with x1873884678797312 ext(0->8) 00002000:00010000:2.0:1787075981.750022:0:6711:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9961b4d1f800 00000100:00100000:2.0:1787075981.752154:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:2.0:1787075981.752176:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2360:x1873884678797312:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787075981.752737:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+10:2360:x1873884678797312:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 Request processed in 568us (2963us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787075981.752747:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00002000:00100000:2.0:1787075981.752758:0:6711:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9961b4d1f800 x1873884678797312/t4294967314(0) o4->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:52/0 lens 504/448 e 0 to 0 dl 1787075992 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787075981.752768:0:6711:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961b4d1f800 with x1873884678797312 ext(0->8) 00002000:00010000:2.0:1787075981.752774:0:6711:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9961b4d1f800 00000100:00100000:0.0:1787075981.766336:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075981.766562:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678797440 00000100:00100000:3.0:1787075981.766572:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678797440 00000100:00100000:3.0:1787075981.766623:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 183 00000100:00100000:3.0:1787075981.766632:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+64:11506:x1873884678797440:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787075981.860799:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+64:11506:x1873884678797440:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 Request processed in 94154us (94461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075981.860813:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 183 00000001:00080000:2.0:1787075981.860861:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:2.0:1787075981.860917:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787075981.860934:0:5874:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996190089c00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787075981.860938:0:5874:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9961a6e11400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9961900899c0 00000020:00080000:2.0:1787075981.860942:0:5874:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9961a6e11e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff996190f60400 00000001:00080000:2.0:1787075981.860966:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:2.0:1787075981.860971:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1787075981.861125:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1787075981.861308:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787075981.861376:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700810752:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787075981.861440:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075981.861516:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787075981.861523:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700810880:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787075981.861563:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075981.861602:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700810752 00000100:00100000:2.0:1787075981.861609:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700810752 00000100:00100000:2.0:1787075981.861669:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700810880 00000100:00100000:2.0:1787075981.861673:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700810880 00000100:00100000:2.0:1787075981.861696:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787075981.861718:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700810752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787075981.861743:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1787075981.861779:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a849d8b, atime: 0x6a849d8b, ctime: 0x6a849d8b, blocks: 0xb 00010000:00010000:2.0:1787075981.861789:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac269b95/0x859911ad686a0136 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.861809:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1787075981.861815:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787075981.861822:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac269b95/0x859911ad686a0136 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.861842:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac269b95/0x859911ad686a0136 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.861853:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac269b95/0x859911ad686a0136 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.861861:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac269b95/0x859911ad686a0136 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.861878:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787075981.862362:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1873884700810752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 644us (921us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787075981.862370:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787075981.862386:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787075981.862393:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700810880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787075981.862491:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787075981.862494:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787075982 00002000:00010000:2.0:1787075981.862496:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787075981.862499:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787075981 -> 1787075982 00002000:00010000:2.0:1787075981.862500:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787075981.862523:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1873884700810880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (960us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787075981.862528:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1787075981.862550:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787075981.862554:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787075981.862566:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787075981.862574:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac269b95/0x859911ad686a0136 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.862584:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841e00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787075981.862588:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac269b95/0x859911ad686a0136 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787075981.863931:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9961b52cb480/2, rc 0, transno 4294967315 00000100:00100000:3.0:1787075981.863944:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700810880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787075981.863958:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1787075981.863963:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1787075981.863985:0:3313:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9961b52c9880 x1873884700810752/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787075997 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787075981.863994:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9961b52c9880/2, rc 0, transno 4294967307 00000100:00100000:3.0:1787075981.863999:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700810752:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787075981.866598:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac269b95/0x859911ad686a0136 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.866776:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac269b95/0x859911ad686a0136 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.866817:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac269b95/0x859911ad686a0136 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.866929:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075981.866931:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075981.866935:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787075981.869055:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075981.869449:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678797568 00000100:00100000:2.0:1787075981.869460:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678797568 00000100:00100000:2.0:1787075981.869510:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:2.0:1787075981.869521:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+10:2361:x1873884678797568:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787075981.912953:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+10:2361:x1873884678797568:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 Request processed in 43423us (43898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075981.912968:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 55 00000001:00080000:0.0:1787075981.913360:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1787075981.913373:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1787075981.913378:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1787075981.924976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075981.925291:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678797824 00000100:00100000:0.0:1787075981.925308:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678797824 00000100:00100000:0.0:1787075981.925379:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 184 00000100:00100000:0.0:1787075981.925389:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+18:11506:x1873884678797824:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787075981.925447:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075981.925488:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0121 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236b0 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.925528:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996194304800) 00010000:00010000:0.0:1787075981.925532:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787075981.925578:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a013d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.925591:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a013d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.925601:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a013d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787075981.925913:0:7654:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 000000000932bd0e reply state 000000006b2f56af transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a013d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075981.925925:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787075981.926031:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+19:11506:x1873884678797824:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 642us (1066us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1787075981.926040:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 184 00010000:00010000:0.0:1787075981.930684:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a013d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.930715:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a013d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.930724:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a013d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.930730:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69e00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075981.930736:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a013d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.930760:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a013d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.930781:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996194304800) 00010000:00010000:0.0:1787075981.930785:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075981.930791:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a013d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.930798:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a013d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075981.933971:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075981.934103:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678797952 00000100:00100000:1.0:1787075981.934123:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678797952 00000100:00100000:1.0:1787075981.934194:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:1.0:1787075981.934205:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2362:x1873884678797952:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787075981.934517:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787075981.934521:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787075982 -> 1787075980 00002000:00010000:1.0:1787075981.934524:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787075979 00002000:00010000:1.0:1787075981.934526:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787075982 -> 1787075980 00002000:00010000:1.0:1787075981.934528:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787075981.934588:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2362:x1873884678797952:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 383us (628us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787075981.934597:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:3.0:1787075981.946251:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075981.952759:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678798208 00000100:00100000:2.0:1787075981.952778:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678798208 00000100:00100000:2.0:1787075981.956965:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 185 00000100:00100000:2.0:1787075981.956993:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+18:11506:x1873884678798208:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787075981.957076:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0144 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.957096:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0105 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236a2 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.957105:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0144 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.957163:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0105 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236a2 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.957177:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0105 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236a2 expref: 18 pid: 5852 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075981.957191:0:5853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1873884700811008:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787075981.957304:0:5853:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616000 going to sleep for 11 seconds 00000100:00100000:2.0:1787075981.964069:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075981.964141:0:5853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1873884700811008:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787075981.964177:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0144 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075981.964209:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678798336 00000100:00100000:2.0:1787075981.964216:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678798336 00010000:00010000:2.0:1787075981.964248:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0105 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236a2 expref: 19 pid: 5852 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075981.964281:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:2.0:1787075981.964292:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+19:2362:x1873884678798336:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075981.964310:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075981.964317:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0105 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236a2 expref: 19 pid: 5852 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.964328:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0105 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236a2 expref: 19 pid: 5852 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.964364:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0105 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236a2 expref: 19 pid: 5852 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.964381:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996194304800) 00010000:00010000:2.0:1787075981.964385:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0144 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.964394:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0144 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.964402:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0144 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.964422:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075981.964472:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+18:2362:x1873884678798336:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 181us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075981.964480:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 68 00010000:00010000:2.0:1787075981.964506:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0144 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.964514:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0144 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.964545:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0144 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.964551:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0144 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.964558:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0144 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.964571:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075981.964576:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0144 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.964584:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0144 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.964593:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996194304800) 00010000:00010000:2.0:1787075981.964595:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787075981.964599:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0144 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.964603:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0144 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075981.964655:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+17:11506:x1873884678798208:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 Request processed in 7660us (18398us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787075981.964664:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 185 00000100:00100000:2.0:1787075981.968856:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075981.968931:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678798464 00000100:00100000:1.0:1787075981.968944:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678798464 00000100:00100000:1.0:1787075981.969008:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:1.0:1787075981.969019:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2361:x1873884678798464:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787075981.969068:0:8477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000440d4c91/0x859911ad686a014b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.969091:0:8477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a012f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236be expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.969099:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787075981.969104:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787075981.969109:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000440d4c91/0x859911ad686a014b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.969151:0:8477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a012f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236be expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.969179:0:8477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a012f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236be expref: 8 pid: 6706 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075981.969198:0:8477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b4d1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8477:1873884700811136:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787075981.969296:0:8477:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187940900 going to sleep for 11 seconds 00000100:00100000:1.0:1787075981.977187:0:8477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b4d1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8477:1873884700811136:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787075981.977218:0:8477:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000440d4c91/0x859911ad686a014b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075981.994189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075981.994272:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678798592 00000100:00100000:2.0:1787075981.994282:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678798592 00010000:00010000:2.0:1787075981.994391:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a012f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236be expref: 9 pid: 6706 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075981.994437:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:2.0:1787075981.994448:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:2362:x1873884678798592:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075981.994462:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075981.994496:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a012f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236be expref: 9 pid: 6706 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.994523:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a012f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236be expref: 9 pid: 6706 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.994549:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a012f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236be expref: 9 pid: 6706 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.994564:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787075981.994569:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787075981.994574:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000440d4c91/0x859911ad686a014b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.994583:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000440d4c91/0x859911ad686a014b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075981.994734:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075981.994792:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2362:x1873884678798592:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 345us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075981.994801:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 69 00010000:00010000:0.0:1787075981.997159:0:8477:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000440d4c91/0x859911ad686a014b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075981.997184:0:8477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000440d4c91/0x859911ad686a014b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.997285:0:8477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000440d4c91/0x859911ad686a014b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.997297:0:8477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000440d4c91/0x859911ad686a014b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.997316:0:8477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000440d4c91/0x859911ad686a014b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.997324:0:8477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632a00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787075981.997329:0:8477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000440d4c91/0x859911ad686a014b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.997338:0:8477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000440d4c91/0x859911ad686a014b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.997371:0:8477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000440d4c91/0x859911ad686a014b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075981.997378:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000440d4c91/0x859911ad686a014b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075981.997497:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2361:x1873884678798464:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 Request processed in 28473us (28646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075981.997508:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:3.0:1787075982.000267:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075982.000363:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678798848 00000100:00100000:0.0:1787075982.000372:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678798848 00000100:00100000:0.0:1787075982.000431:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 186 00000100:00100000:0.0:1787075982.000441:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+17:11506:x1873884678798848:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787075982.000538:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0152 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.000557:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0152 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.000570:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0152 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.000848:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0159 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.000861:0:7654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a0113 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236a9 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.000870:0:7654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0159 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.000904:0:7654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a0113 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236a9 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.000917:0:7654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a0113 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236a9 expref: 18 pid: 5852 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075982.000932:0:7654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b91b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1873884700811264:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787075982.001025:0:7654:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eeb780 going to sleep for 11 seconds 00000100:00100000:3.0:1787075982.011007:0:7654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b91b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1873884700811264:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075982.011049:0:7654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0159 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075982.011193:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075982.011268:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678798976 00000100:00100000:2.0:1787075982.011275:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678798976 00010000:00010000:2.0:1787075982.011327:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a0113 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236a9 expref: 19 pid: 5852 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075982.011358:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:2.0:1787075982.011369:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+19:2362:x1873884678798976:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075982.011398:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075982.011405:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a0113 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236a9 expref: 19 pid: 5852 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.011418:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a0113 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236a9 expref: 19 pid: 5852 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.011448:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a0113 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236a9 expref: 19 pid: 5852 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.011464:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996194304800) 00010000:00010000:2.0:1787075982.011470:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0159 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.011480:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0159 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.011488:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0159 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.011509:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075982.011562:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+18:2362:x1873884678798976:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 196us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075982.011571:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 70 00010000:00010000:2.0:1787075982.011693:0:7654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0159 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.011713:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0159 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787075982.011925:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1787075982.012087:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1787075982.012134:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1787075982.012213:0:7654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7654:1873884700811392:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787075982.012258:0:7654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075982.012285:0:7654:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9c8cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787075982.012306:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700811392 00000100:00100000:2.0:1787075982.012311:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700811392 00000100:00100000:2.0:1787075982.012341:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787075982.012347:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7654:x1873884700811392:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787075982.012405:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7654:x1873884700811392:12345-0@lo:1000:mdt00_003.0 Request processed in 58us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075982.012411:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787075982.012439:0:7654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1787075982.012444:0:7654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9961b52cb480, transno 4294967315 00000100:00100000:2.0:1787075982.012454:0:7654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7654:1873884700811392:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787075982.013003:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1787075982.013062:0:7654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7654:1873884700811520:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787075982.013098:0:7654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075982.013117:0:7654:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616000 going to sleep for 11 seconds 00000100:00100000:2.0:1787075982.013317:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700811520 00000100:00100000:2.0:1787075982.013323:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700811520 00000100:00100000:2.0:1787075982.013352:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787075982.013359:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7654:x1873884700811520:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787075982.013505:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7654:x1873884700811520:12345-0@lo:1000:mdt00_003.0 Request processed in 146us (406us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787075982.013521:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787075982.013564:0:7654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7654:1873884700811520:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787075982.013597:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0159 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.013609:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0159 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.013616:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0159 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.013622:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075982.013627:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0159 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.013634:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0159 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.013673:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff996194304800) 00010000:00010000:2.0:1787075982.013676:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787075982.013680:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0159 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.013686:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0159 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.013743:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a008e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.013750:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a008e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.013767:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a008e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.013772:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075982.013775:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a008e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.013782:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a008e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.013790:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304e00) 00010000:00010000:2.0:1787075982.013792:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787075982.013795:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a008e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.013800:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a008e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.013823:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0160 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.013839:0:7654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a00aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762368d expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.013848:0:7654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0160 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.013877:0:7654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a00aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762368d expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.013903:0:7654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a00aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762368d expref: 21 pid: 5854 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075982.013916:0:7654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1873884700811648:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787075982.013985:0:7654:0:(client.c:2702:ptlrpc_set_wait()) set ffff99619036b6c0 going to sleep for 11 seconds 00000100:00080000:3.0:1787075982.014626:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075982.023181:0:7654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1873884700811648:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075982.023223:0:7654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0160 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075982.025952:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075982.026622:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787075982.026670:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700811776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787075982.026751:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075982.026796:0:9220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700811776 00000100:00100000:2.0:1787075982.026805:0:9220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700811776 00000100:00100000:2.0:1787075982.026865:0:9220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787075982.026877:0:9220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c19d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1873884700811776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787075982.026906:0:9220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787075982.026957:0:9220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c19d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1873884700811776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075982.026964:0:9220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787075982.027262:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700811776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787075982.028200:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678799104 00000100:00100000:0.0:1787075982.028211:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678799104 00010000:00010000:0.0:1787075982.028248:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a00aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762368d expref: 22 pid: 5854 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075982.028284:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 71 00000100:00100000:0.0:1787075982.028293:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+22:2362:x1873884678799104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075982.028306:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075982.028312:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a00aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762368d expref: 22 pid: 5854 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.028341:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a00aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762368d expref: 22 pid: 5854 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.028369:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a00aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762368d expref: 22 pid: 5854 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.028386:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304e00) 00010000:00010000:0.0:1787075982.028391:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0160 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.028400:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0160 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.028407:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0160 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.028437:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075982.028553:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+21:2362:x1873884678799104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 261us (2618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075982.028561:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 71 00000100:00100000:1.0:1787075982.028838:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b4d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700812288:0@lo:400:kworker.0 00000100:00100000:1.0:1787075982.028893:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075982.028922:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787075982.028928:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b4d1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700811904:0@lo:400:kworker.0 00000100:00100000:1.0:1787075982.028956:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075982.028977:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b4d1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873884700812416:0@lo:400:kworker.0 00000100:00100000:1.0:1787075982.029000:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075982.029022:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b4d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700812032:0@lo:400:kworker.0 00000100:00100000:1.0:1787075982.029043:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075982.029057:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787075982.029062:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b4d1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700812160:0@lo:400:kworker.0 00000100:00100000:1.0:1787075982.029083:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075982.029108:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700812288 00000100:00100000:1.0:1787075982.029113:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700812288 00000100:00100000:1.0:1787075982.029160:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787075982.029167:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1873884700812288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075982.029214:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1873884700812288:12345-0@lo:400:kworker.0 Request processed in 47us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075982.029220:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787075982.029238:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700812416 00000100:00100000:1.0:1787075982.029242:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700812416 00000100:00100000:1.0:1787075982.029268:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700812032 00000100:00100000:1.0:1787075982.029271:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700812032 00000100:00100000:1.0:1787075982.029282:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700812160 00000100:00100000:1.0:1787075982.029284:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700812160 00000100:00100000:1.0:1787075982.029298:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787075982.029304:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873884700812416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075982.029333:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873884700812416:12345-0@lo:400:kworker.0 Request processed in 29us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075982.029339:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787075982.029349:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787075982.029355:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700812032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075982.029380:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700812032:12345-0@lo:400:kworker.0 Request processed in 26us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075982.029386:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787075982.029395:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787075982.029400:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700812160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075982.029421:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700812160:12345-0@lo:400:kworker.0 Request processed in 21us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075982.029426:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:1.0:1787075982.029445:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075982.032356:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b4d1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700812160:0@lo:400:kworker.0 00000100:00100000:1.0:1787075982.032401:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b4d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700812032:0@lo:400:kworker.0 00000100:00100000:1.0:1787075982.032491:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b4d1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873884700812416:0@lo:400:kworker.0 00000100:00100000:1.0:1787075982.032506:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b4d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700812288:0@lo:400:kworker.0 00010000:00010000:0.0:1787075982.032705:0:7654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0160 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.032719:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0160 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.032738:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0160 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.032778:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0160 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.032786:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0160 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.032793:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075982.032797:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0160 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.032806:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0160 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.032826:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304e00) 00010000:00010000:0.0:1787075982.032829:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075982.032835:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0160 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.032841:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0160 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.032860:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0152 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.032866:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0152 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.032872:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0152 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.032877:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075982.032890:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0152 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.032896:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0152 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.032903:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304e00) 00010000:00010000:0.0:1787075982.032906:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787075982.032908:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0152 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.032915:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0152 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075982.033238:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+20:11506:x1873884678798848:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 32793us (32975us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1787075982.033250:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 186 00000020:00080000:0.0:1787075982.033256:0:7654:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787075982.033412:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700811904 00000100:00100000:2.0:1787075982.033421:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700811904 00000100:00100000:2.0:1787075982.033468:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787075982.033478:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3311:x1873884700811904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075982.033550:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3311:x1873884700811904:12345-0@lo:400:kworker.0 Request processed in 75us (4592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075982.033558:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787075982.033772:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b4d1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700811904:0@lo:400:kworker.0 00000040:00080000:2.0:1787075982.033910:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787075982.033914:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787075982.034429:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787075982.034437:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787075982.035892:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075982.036662:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678799360 00000100:00100000:2.0:1787075982.036675:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678799360 00000100:00100000:2.0:1787075982.036743:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:2.0:1787075982.036752:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b0115850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+20:11506:x1873884678799360:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787075982.037465:0:5856:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787075982.037588:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:2.0:1787075982.037636:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0167 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.037682:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.037710:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.037721:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0167 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.037727:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0167 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.037732:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0167 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.037752:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787075982.037858:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b0115850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+22:11506:x1873884678799360:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 1104us (1974us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1787075982.037873:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 50 00000020:00080000:2.0:1787075982.037879:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787075982.038347:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787075982.038355:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0167 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.038362:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840600 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787075982.038365:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0167 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.038372:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0167 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.038384:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99619211c300) 00010000:00010000:1.0:1787075982.038386:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787075982.038392:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0167 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.038397:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0167 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.038416:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075982.038418:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075982.038419:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787075982.137332:0:12470:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787075982.137344:0:12470:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787075982.137386:0:12470:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787075982.137393:0:12470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787075982.222420:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075982.260673:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075982.261394:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678799616 00000100:00100000:1.0:1787075982.261410:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678799616 00000100:00100000:1.0:1787075982.261479:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 187 00000100:00100000:1.0:1787075982.261499:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+22:11516:x1873884678799616:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787075982.261528:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075982.261551:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a016e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76236c5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.262008:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad686a0175 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.262023:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad686a0175 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.262035:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad686a0175 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075982.262047:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787075982.262214:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a016e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236c5 expref: 25 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.262231:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad686a0175 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236c5 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.262239:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:1.0:1787075982.262242:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787075982.262245:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf633400, rc 0) 00000100:00100000:1.0:1787075982.262299:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+24:11516:x1873884678799616:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 803us (1640us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787075982.262306:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 187 00000100:00100000:1.0:1787075982.267810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075982.268422:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678799744 00000100:00100000:2.0:1787075982.268434:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678799744 00000100:00100000:2.0:1787075982.268561:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 188 00000100:00100000:2.0:1787075982.268573:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+24:11516:x1873884678799744:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:2.0:1787075982.268678:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0183 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.268715:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0183 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.268729:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0183 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.268747:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a018a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.268755:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a018a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.268760:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a018a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.269092:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0191 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.269101:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.269116:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787075982.270702:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270727:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0183 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270734:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0183 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270742:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0183 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270749:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075982.270754:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0183 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270762:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0183 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270777:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:2.0:1787075982.270780:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075982.270785:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0183 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270792:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0183 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270807:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a018a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270821:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a018a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270828:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a018a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270833:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075982.270836:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a018a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270842:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a018a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270849:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99619211ce00) 00010000:00010000:2.0:1787075982.270851:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075982.270854:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a018a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270860:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a018a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270874:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270880:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0191 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270886:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0191 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270891:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075982.270898:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0191 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270905:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0191 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270912:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99619211c700) 00010000:00010000:2.0:1787075982.270914:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075982.270916:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0191 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.270922:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0191 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075982.271587:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+24:11516:x1873884678799744:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 3010us (3781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075982.271599:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 188 00000100:00100000:3.0:1787075982.343421:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075982.343471:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678800000 00000100:00100000:3.0:1787075982.343483:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678800000 00000100:00100000:3.0:1787075982.343537:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 189 00000100:00100000:3.0:1787075982.343548:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+24:11519:x1873884678800000:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787075982.343571:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075982.343595:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0198 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76236cc expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.343744:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a019f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.343759:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a019f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.343772:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a019f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.343788:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a01a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.343794:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a01a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.343800:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a01a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344188:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a01ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344198:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a01ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344206:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a01ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075982.344216:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787075982.344323:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a019f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344330:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a019f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344343:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a019f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344350:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075982.344356:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a019f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344364:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a019f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344377:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:3.0:1787075982.344379:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075982.344384:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a019f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344390:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a019f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344402:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a01a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344408:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a01a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344414:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a01a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344420:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075982.344423:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a01a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344438:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a01a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344447:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996194304700) 00010000:00010000:3.0:1787075982.344449:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075982.344452:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a01a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344458:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a01a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344513:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0198 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236cc expref: 27 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344527:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a01ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236cc expref: 26 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.344535:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304500) 00010000:00010000:3.0:1787075982.344537:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787075982.344540:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523a00, rc 0) 00000100:00100000:3.0:1787075982.344613:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+26:11519:x1873884678800000:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1066us (1201us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787075982.344621:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 189 00000100:00100000:3.0:1787075982.350048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075982.350083:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678800128 00000100:00100000:3.0:1787075982.350092:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678800128 00000100:00100000:3.0:1787075982.350167:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 190 00000100:00100000:3.0:1787075982.350177:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+26:11519:x1873884678800128:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:3.0:1787075982.350260:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.350277:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.350290:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.350324:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.350331:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.350337:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.350343:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075982.350348:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.350356:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.350370:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304500) 00010000:00010000:3.0:1787075982.350374:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787075982.350380:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.350386:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075982.350483:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+26:11519:x1873884678800128:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 307us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075982.350491:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 190 00000100:00100000:3.0:1787075982.358190:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075982.358320:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678800384 00000100:00100000:0.0:1787075982.358330:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678800384 00000100:00100000:0.0:1787075982.358392:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:0.0:1787075982.358403:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+26:11519:x1873884678800384:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1787075982.358702:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+27:11519:x1873884678800384:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 299us (524us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787075982.358710:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:0.0:1787075982.402736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075982.402873:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678800640 00000100:00100000:3.0:1787075982.402886:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678800640 00000100:00100000:3.0:1787075982.402948:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 191 00000100:00100000:3.0:1787075982.402960:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+27:11054:x1873884678800640:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787075982.402989:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075982.403009:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a01c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76236d3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.403112:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.403127:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a01ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236cc expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.403139:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01c9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.403183:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a01ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236cc expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.403199:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a01ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236cc expref: 28 pid: 5854 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075982.403241:0:5854:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1873884700812544:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787075982.403342:0:5854:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787075982.410963:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075982.411060:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678800768 00000100:00100000:2.0:1787075982.411074:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678800768 00010000:00010000:2.0:1787075982.411129:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a01ad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236cc expref: 29 pid: 5854 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075982.411182:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00100000:2.0:1787075982.411194:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+29:2362:x1873884678800768:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075982.411211:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075982.411220:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a01ad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236cc expref: 29 pid: 5854 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.411234:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a01ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236cc expref: 29 pid: 5854 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.411264:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304500) 00010000:00010000:2.0:1787075982.411269:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.411279:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.411287:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01c9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.411307:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075982.411368:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+29:2362:x1873884678800768:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 176us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075982.411377:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 72 00010000:00010000:3.0:1787075982.412569:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a01ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236cc expref: 28 pid: 5854 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075982.412590:0:5854:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1873884700812544:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075982.412617:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.412626:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.412631:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075982.413789:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787075982.414211:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a01c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236d3 expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.414234:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236d3 expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.414244:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304500) 00010000:00010000:2.0:1787075982.414247:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787075982.414250:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522a00, rc 0) 00000100:00100000:2.0:1787075982.414438:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+28:11054:x1873884678800640:12345-192.168.204.50@tcp:101:bash.0 Request processed in 11480us (11713us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1787075982.414449:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 191 00000100:00100000:1.0:1787075982.418489:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075982.418564:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678801024 00000100:00100000:3.0:1787075982.418574:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678801024 00000100:00100000:3.0:1787075982.418636:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 192 00000100:00100000:3.0:1787075982.418677:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+28:11054:x1873884678801024:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:3.0:1787075982.419011:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a01d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.419033:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a01d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.419044:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a01d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787075982.419115:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:3.0:1787075982.419147:0:5853:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 0000000054b1abce reply state 000000008e67e3da transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a01d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075982.419156:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787075982.419240:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:3.0:1787075982.419354:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+32:11054:x1873884678801024:12345-192.168.204.50@tcp:36:bash.0 Request processed in 679us (874us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1787075982.419363:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 192 00000020:00080000:3.0:1787075982.419368:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787075982.422676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075982.422759:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678801152 00000100:00100000:0.0:1787075982.422770:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678801152 00000100:00100000:0.0:1787075982.422844:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 193 00000100:00100000:0.0:1787075982.422856:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+32:11054:x1873884678801152:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1787075982.422904:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075982.422927:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad686a01de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76236da expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.422993:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad686a01de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236da expref: 33 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.423009:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad686a01de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236da expref: 33 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.423030:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304500) 00010000:00010000:0.0:1787075982.423033:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787075982.423037:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe69800, rc 0) 00000100:00100000:0.0:1787075982.423098:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+33:11054:x1873884678801152:12345-192.168.204.50@tcp:101:bash.0 Request processed in 244us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075982.423105:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 193 00010000:00010000:3.0:1787075982.425824:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a01d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.425954:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a01d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.425961:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a01d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.425967:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075982.425972:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a01d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.425980:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a01d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.425999:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304500) 00010000:00010000:3.0:1787075982.426002:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075982.426007:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a01d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.426037:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a01d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075982.426373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075982.426472:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678801280 00000100:00100000:3.0:1787075982.426481:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678801280 00000100:00100000:3.0:1787075982.426567:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:3.0:1787075982.426578:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:11054:x1873884678801280:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787075982.426598:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075982.426619:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba586150/0x859911ad686a01e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76236e1 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787075982.426740:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a849d8c, atime: 0x6a849d8b, ctime: 0x6a849d8c, blocks: 0xb 00010000:00010000:3.0:1787075982.426767:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=364s v=(0 0) 00010000:00010000:3.0:1787075982.426772:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787075982.426782:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba586150/0x859911ad686a01e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236e1 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.426799:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ba586150/0x859911ad686a01e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236e1 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.426811:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523a00, rc 0) 00000100:00100000:3.0:1787075982.426882:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:11054:x1873884678801280:12345-192.168.204.50@tcp:101:bash.0 Request processed in 306us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075982.426889:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:1.0:1787075982.429365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075982.429465:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678801408 00000100:00100000:0.0:1787075982.429475:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678801408 00002000:00010000:0.0:1787075982.429516:0:6709:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1787075982.429521:0:6709:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996184e66a00 with x1873884678801408 ext(0->18446744073709551615) 00002000:00010000:0.0:1787075982.429534:0:6709:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff996184e66a00. 00000100:00100000:0.0:1787075982.429597:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:0.0:1787075982.429608:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2362:x1873884678801408:12345-192.168.204.50@tcp:10:bash.0 00002000:00010000:0.0:1787075982.430089:0:6709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787075982.430093:0:6709:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787075980 -> 1787075982 00002000:00010000:0.0:1787075982.430095:0:6709:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787075979 -> 1787075979 00002000:00010000:0.0:1787075982.430112:0:6709:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787075980 -> 1787075982 00002000:00010000:0.0:1787075982.430114:0:6709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787075982.430233:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:2362:x1873884678801408:12345-192.168.204.50@tcp:10:bash.0 Request processed in 625us (874us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787075982.430242:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00002000:00010000:0.0:1787075982.430246:0:6709:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1787075982.430249:0:6709:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff996184e66a00 with x1873884678801408 ext(0->18446744073709551615) 00002000:00010000:0.0:1787075982.430255:0:6709:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff996184e66a00. 00000100:00100000:0.0:1787075982.517082:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075982.517360:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678801536 00000100:00100000:2.0:1787075982.517389:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678801536 00000100:00100000:2.0:1787075982.517732:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 194 00000100:00100000:2.0:1787075982.517744:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+32:11533:x1873884678801536:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:2.0:1787075982.517825:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a01ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.517854:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a01ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.517866:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a01ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.517881:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a01f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.517888:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a01f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.517895:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a01f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518202:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad686a01fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518212:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad686a01fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518220:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad686a01fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787075982.518259:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad686a01fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518280:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a01ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518286:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a01ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518293:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a01ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518299:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075982.518303:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a01ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518310:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a01ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518322:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:2.0:1787075982.518325:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075982.518329:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a01ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518334:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a01ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518345:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a01f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518351:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a01f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518356:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a01f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518367:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075982.518370:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a01f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518375:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a01f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518383:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99619211c700) 00010000:00010000:2.0:1787075982.518385:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075982.518387:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a01f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518392:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a01f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518405:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad686a01fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518410:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad686a01fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518415:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad686a01fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518420:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075982.518422:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad686a01fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518428:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad686a01fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518445:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304500) 00010000:00010000:2.0:1787075982.518448:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075982.518451:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad686a01fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.518456:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840400/0x859911ad686a01fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075982.518546:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+32:11533:x1873884678801536:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 804us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075982.518555:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 194 00000100:00100000:2.0:1787075982.564010:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075982.564132:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678801792 00000100:00100000:1.0:1787075982.564146:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678801792 00000100:00100000:1.0:1787075982.564215:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 195 00000100:00100000:1.0:1787075982.564226:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+32:11536:x1873884678801792:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787075982.564251:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075982.564274:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad686a0201 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76236e8 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.564377:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a0208 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.564394:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a0208 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.564407:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a0208 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.564427:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a020f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.564436:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a020f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.564443:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a020f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.564844:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad686a0216 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.564863:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad686a0216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.564870:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad686a0216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075982.564882:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787075982.564981:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a0208 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.564990:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a0208 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.564998:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a0208 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.565005:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075982.565010:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a0208 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.565020:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a0208 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.565036:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:1.0:1787075982.565040:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075982.565045:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a0208 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.565052:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a0208 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.565065:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a020f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.565078:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a020f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.565084:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a020f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.565089:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075982.565093:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a020f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.565099:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a020f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.565106:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996187c34b00) 00010000:00010000:1.0:1787075982.565109:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075982.565112:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a020f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.565119:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a020f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.565168:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad686a0201 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236e8 expref: 35 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.565181:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad686a0216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236e8 expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.565189:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304500) 00010000:00010000:1.0:1787075982.565192:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787075982.565199:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf633800, rc 0) 00000100:00100000:1.0:1787075982.565275:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+34:11536:x1873884678801792:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1050us (1278us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1787075982.565284:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 195 00000100:00100000:1.0:1787075982.571062:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075982.571761:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678801920 00000100:00100000:3.0:1787075982.571772:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678801920 00000100:00100000:3.0:1787075982.571857:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 196 00000100:00100000:3.0:1787075982.571868:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+34:11536:x1873884678801920:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:3.0:1787075982.571941:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0224 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.571959:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01c9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236d3 expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.571969:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0224 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.572012:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236d3 expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.572028:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236d3 expref: 34 pid: 5854 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075982.572046:0:5853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1873884700812672:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787075982.573711:0:5853:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787075982.592529:0:5853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1873884700812672:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075982.592562:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0224 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075982.600596:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075982.602167:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678802176 00000100:00100000:0.0:1787075982.602190:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678802176 00000100:00100000:0.0:1787075982.602278:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:0.0:1787075982.602292:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+35:5600:x1873884678802176:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787075982.602744:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+36:5600:x1873884678802176:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 454us (2158us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1787075982.602751:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:2.0:1787075982.606721:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075982.607564:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678802304 00000100:00100000:0.0:1787075982.607576:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678802304 00010000:00010000:0.0:1787075982.607621:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236d3 expref: 36 pid: 5854 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075982.607770:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:0.0:1787075982.607780:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+36:2361:x1873884678802304:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075982.607794:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075982.607801:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236d3 expref: 36 pid: 5854 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.607833:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236d3 expref: 36 pid: 5854 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.607855:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a01c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236d3 expref: 36 pid: 5854 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.607873:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304500) 00010000:00010000:0.0:1787075982.607879:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0224 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.607888:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.607896:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0224 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.607990:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075982.608053:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+35:2361:x1873884678802304:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 274us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075982.608061:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 73 00010000:00010000:3.0:1787075982.616514:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.616532:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.616591:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.616599:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0224 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.616606:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0224 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.616613:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075982.616617:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0224 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.616625:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0224 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.616781:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304500) 00010000:00010000:3.0:1787075982.616785:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787075982.616790:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0224 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.616795:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0224 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075982.622675:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+34:11536:x1873884678801920:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 50772us (51589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075982.622704:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 196 00000100:00100000:2.0:1787075982.625537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075982.625672:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678802560 00000100:00100000:0.0:1787075982.625692:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678802560 00000100:00100000:0.0:1787075982.625755:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:0.0:1787075982.625767:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+34:11536:x1873884678802560:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1787075982.626032:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+35:11536:x1873884678802560:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 266us (509us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787075982.626039:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:1.0:1787075982.626436:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075982.626539:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678802688 00000100:00100000:3.0:1787075982.626546:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678802688 00000100:00100000:1.0:1787075982.626551:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075982.626589:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 292 00000100:00100000:0.0:1787075982.626735:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678802944 00000100:00100000:0.0:1787075982.626739:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678802944 00000100:00100000:0.0:1787075982.626777:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 152 00000100:00100000:0.0:1787075982.626784:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2361:x1873884678802944:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075982.626826:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2361:x1873884678802944:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 43us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075982.626833:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 152 00000100:00100000:3.0:1787075982.626919:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2361:x1873884678802688:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075982.626969:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2361:x1873884678802688:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 371us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075982.626988:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 292 00000100:00080000:1.0:1787075982.627077:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787075982.628440:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075982.630274:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678802816 00000100:00100000:1.0:1787075982.630305:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678802816 00000100:00100000:1.0:1787075982.630421:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:1.0:1787075982.630435:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678802816:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075982.630531:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678802816:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 100us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075982.630539:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00080000:2.0:1787075982.632097:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787075982.760435:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075982.760795:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678803200 00000100:00100000:2.0:1787075982.760811:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678803200 00000100:00100000:2.0:1787075982.760899:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 197 00000100:00100000:2.0:1787075982.760911:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+35:11547:x1873884678803200:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1787075982.760947:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075982.760970:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a022b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76236ef expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761053:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0232 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761103:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0232 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761115:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0232 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761131:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0239 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761138:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0239 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761144:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0239 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761518:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0240 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761529:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761538:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075982.761562:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787075982.761733:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0232 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761742:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0232 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761749:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0232 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761761:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075982.761766:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0232 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761773:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0232 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761786:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:2.0:1787075982.761788:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075982.761793:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0232 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761799:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0232 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761812:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0239 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761818:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0239 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761824:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0239 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761829:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075982.761832:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0239 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761838:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0239 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761856:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99619211c700) 00010000:00010000:2.0:1787075982.761858:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075982.761861:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0239 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761866:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0239 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761910:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a022b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236ef expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761924:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0240 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236ef expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.761931:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304500) 00010000:00010000:2.0:1787075982.761933:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787075982.761936:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1841800, rc 0) 00000100:00100000:2.0:1787075982.762014:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+37:11547:x1873884678803200:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1105us (1591us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787075982.762023:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 197 00000100:00100000:3.0:1787075982.775267:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075982.776050:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678803456 00000100:00100000:0.0:1787075982.776062:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678803456 00000100:00100000:0.0:1787075982.776135:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:0.0:1787075982.776146:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+37:11547:x1873884678803456:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:0.0:1787075982.776419:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+38:11547:x1873884678803456:12345-192.168.204.50@tcp:35:cat.0 Request processed in 274us (1160us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787075982.776427:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:0.0:1787075982.808516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075982.808690:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678803712 00000100:00100000:1.0:1787075982.808700:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678803712 00000100:00100000:1.0:1787075982.808751:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 198 00000100:00100000:1.0:1787075982.808762:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+38:11548:x1873884678803712:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:1.0:1787075982.808820:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787075982.808860:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841800/0x859911ad686a0240 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236ef expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.808952:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633800/0x859911ad686a0216 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236e8 expref: 37 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.808989:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69800/0x859911ad686a01de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236da expref: 36 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.809001:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996194304500) 00010000:00010000:1.0:1787075982.809029:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787075982.809051:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad686a024e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.809063:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad686a024e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.809072:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad686a024e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.809088:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0255 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.809094:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0255 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.809101:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0255 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.810259:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a025c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.810274:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a025c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.810284:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a025c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787075982.812872:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787075982.812953:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364788312113ns, next at 365788308018ns, rc = 0 00010000:00010000:0.0:1787075982.813040:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0263 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813056:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813066:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813087:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0263 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813094:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0263 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813101:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0263 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813167:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787075982.813194:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a025c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813201:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a025c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813207:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a025c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813213:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075982.813218:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a025c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813225:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a025c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813238:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996187c34800) 00010000:00010000:0.0:1787075982.813241:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787075982.813246:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a025c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813263:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633200/0x859911ad686a025c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813283:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad686a024e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813361:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad686a024e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813367:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad686a024e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813372:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075982.813375:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad686a024e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813381:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad686a024e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813390:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:0.0:1787075982.813392:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075982.813395:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad686a024e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.813401:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632600/0x859911ad686a024e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787075982.813413:0:5854:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 000000000869383a reply state 0000000043e1699d transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0255 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075982.813422:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787075982.813577:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+37:11548:x1873884678803712:12345-192.168.204.50@tcp:36:rm.0 Request processed in 4811us (5068us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1787075982.813588:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 198 00010000:00010000:1.0:1787075982.813694:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787075982.813701:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0263 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.813708:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68000 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787075982.813711:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0263 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.813717:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0263 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.813727:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff996187c34800) 00010000:00010000:1.0:1787075982.813730:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787075982.813733:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0263 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.813739:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68000/0x859911ad686a0263 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.813761:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075982.813763:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075982.813765:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787075982.818690:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0255 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.818708:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0255 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.818715:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0255 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.818721:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075982.818726:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0255 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.818733:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0255 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.818751:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996187c34b00) 00010000:00010000:0.0:1787075982.818754:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075982.818759:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0255 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075982.818764:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0255 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075982.903363:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075982.903471:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678803968 00000100:00100000:2.0:1787075982.903482:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678803968 00000100:00100000:2.0:1787075982.903546:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 199 00000100:00100000:2.0:1787075982.903559:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+36:11554:x1873884678803968:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1787075982.903592:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075982.903616:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a026a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76236f6 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.903843:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0271 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.903862:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0271 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.903875:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0271 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.903901:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0278 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.903909:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.903916:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787075982.904447:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787075982.904617:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841a00/0x859911ad686a027f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.904627:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841a00/0x859911ad686a027f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.904635:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841a00/0x859911ad686a027f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.904712:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0271 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.904731:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0271 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.904738:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0271 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.904744:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075982.904749:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0271 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.904756:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0271 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.904769:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:2.0:1787075982.904772:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075982.904776:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0271 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.904781:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0271 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787075982.904794:0:5852:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 0000000062d3520f reply state 00000000644f18bc transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075982.904803:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787075982.904833:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840000/0x859911ad686a026a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236f6 expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.904847:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841a00/0x859911ad686a027f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236f6 expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.904865:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:2.0:1787075982.904868:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787075982.904871:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1841a00, rc 0) 00000100:00100000:2.0:1787075982.904950:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+39:11554:x1873884678803968:12345-192.168.204.50@tcp:101:bash.0 Request processed in 1394us (1598us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787075982.904959:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 199 00010000:00010000:2.0:1787075982.918405:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.918427:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0278 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.918435:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0278 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.918442:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075982.918453:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0278 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.918462:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0278 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.918480:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99619211c700) 00010000:00010000:2.0:1787075982.918484:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075982.918498:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0278 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.918505:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0278 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075982.926549:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075982.932415:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678804096 00000100:00100000:2.0:1787075982.932431:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678804096 00000100:00100000:3.0:1787075982.937815:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:3.0:1787075982.937830:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678804096:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787075982.937853:0:8477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075982.938161:0:8477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000980ba157/0x859911ad686a028d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76236fd expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787075982.938190:0:8477:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787075982.938213:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=364s v=(0 0) 00010000:00010000:3.0:1787075982.938218:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787075982.938345:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000980ba157/0x859911ad686a028d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236fd expref: 6 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.938371:0:8477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000980ba157/0x859911ad686a028d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236fd expref: 6 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.938388:0:8477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523400, rc 0) 00000100:00100000:3.0:1787075982.938479:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2362:x1873884678804096:12345-192.168.204.50@tcp:101:bash.0 Request processed in 651us (11938us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075982.938487:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:3.0:1787075982.953167:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075982.953279:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678804224 00000100:00100000:1.0:1787075982.953289:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678804224 00000100:00100000:1.0:1787075982.953352:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:1.0:1787075982.953363:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:11554:x1873884678804224:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1787075982.953383:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075982.953403:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000598af6be/0x859911ad686a0294 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623704 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.953451:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000980ba157/0x859911ad686a028d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236fd expref: 7 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.953462:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787075982.953466:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787075982.953472:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000598af6be/0x859911ad686a0294 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623704 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.953510:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000980ba157/0x859911ad686a028d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236fd expref: 7 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075982.953524:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000980ba157/0x859911ad686a028d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236fd expref: 7 pid: 8477 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075982.953539:0:6706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bec0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1873884700812800:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787075982.953669:0:6706:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187940e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787075982.967987:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bec0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1873884700812800:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075982.968029:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000598af6be/0x859911ad686a0294 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623704 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075982.968068:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf633600, rc 0) 00000100:00100000:3.0:1787075982.979451:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:11554:x1873884678804224:12345-192.168.204.50@tcp:101:bash.0 Request processed in 26074us (26281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075982.979465:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:1.0:1787075982.983538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075982.993031:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678804352 00000100:00100000:2.0:1787075982.993047:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678804352 00010000:00010000:2.0:1787075982.993106:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000980ba157/0x859911ad686a028d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236fd expref: 7 pid: 8477 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075982.993287:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00100000:2.0:1787075982.993299:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a0262450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2362:x1873884678804352:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075982.993332:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075982.993357:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000980ba157/0x859911ad686a028d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236fd expref: 7 pid: 8477 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.993373:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000980ba157/0x859911ad686a028d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236fd expref: 7 pid: 8477 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.993403:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000980ba157/0x859911ad686a028d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236fd expref: 7 pid: 8477 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.993424:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787075982.993429:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787075982.993438:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000598af6be/0x859911ad686a0294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623704 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.993448:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000598af6be/0x859911ad686a0294 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623704 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075982.993511:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000598af6be/0x859911ad686a0294 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623704 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075982.993528:0:5837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52ca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5837:1873884700812928:192.168.204.50@tcp:105: 00000100:00100000:2.0:1787075982.993632:0:5837:0:(client.c:2702:ptlrpc_set_wait()) set ffff99619036bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787075982.998297:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075982.998520:0:5837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52ca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5837:1873884700812928:192.168.204.50@tcp:105: 00010000:00010000:0.0:1787075982.998551:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075982.998726:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a0262450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2362:x1873884678804352:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5419us (15196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075982.998761:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00100000:1.0:1787075983.005803:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678804608 00000100:00100000:1.0:1787075983.005840:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678804608 00000100:00100000:1.0:1787075983.005938:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:1.0:1787075983.005951:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+38:11554:x1873884678804608:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:1.0:1787075983.006338:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+39:11554:x1873884678804608:12345-192.168.204.50@tcp:35:bash.0 Request processed in 388us (8050us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1787075983.006346:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:2.0:1787075983.051159:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bec09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700813056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787075983.051242:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075983.051352:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700813056 00000100:00100000:1.0:1787075983.051360:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700813056 00000100:00100000:1.0:1787075983.051433:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787075983.051444:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1873884700813056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787075983.051491:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787075983.051550:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1873884700813056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075983.051557:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1787075983.051974:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787075983.052446:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bec09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700813056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787075983.215133:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075983.218090:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678804736 00000100:00100000:0.0:1787075983.218109:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678804736 00000100:00100000:0.0:1787075983.218210:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 200 00000100:00100000:0.0:1787075983.218222:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+39:11570:x1873884678804736:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787075983.218250:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075983.218275:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68c00/0x859911ad686a029b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762370b expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.218343:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a02a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.218359:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a02a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.218374:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a02a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075983.218438:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787075983.218442:0:7654:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787075983.218465:0:7654:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a02a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.218490:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68c00/0x859911ad686a029b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762370b expref: 41 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.218511:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a02a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762370b expref: 40 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.218534:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:0.0:1787075983.218537:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787075983.218541:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe69e00, rc 0) 00000100:00100000:0.0:1787075983.218619:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+40:11570:x1873884678804736:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 399us (3496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075983.218627:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 200 00000100:00100000:3.0:1787075983.225726:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075983.225848:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678804992 00000100:00100000:2.0:1787075983.225870:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678804992 00000100:00100000:2.0:1787075983.225951:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 201 00000100:00100000:2.0:1787075983.225963:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+40:11570:x1873884678804992:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787075983.225987:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075983.226013:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840200/0x859911ad686a02a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623712 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.226136:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840a00/0x859911ad686a02b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.226154:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840a00/0x859911ad686a02b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.226166:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840a00/0x859911ad686a02b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075983.226200:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787075983.226361:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840200/0x859911ad686a02a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623712 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.226383:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840a00/0x859911ad686a02b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623712 expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.226393:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:2.0:1787075983.226396:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787075983.226400:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1840a00, rc 0) 00000100:00100000:2.0:1787075983.226557:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+42:11570:x1873884678804992:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 596us (848us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787075983.226567:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 201 00000100:00100000:2.0:1787075983.238625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075983.238729:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075983.238838:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678805376 00000100:00100000:3.0:1787075983.238856:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678805376 00000100:00100000:3.0:1787075983.238958:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 202 00000100:00100000:3.0:1787075983.238971:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+42:11570:x1873884678805376:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787075983.239008:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075983.239037:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a02be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623719 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.239190:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a02c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075983.239192:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678805120 00000100:00100000:0.0:1787075983.239208:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678805120 00010000:00010000:3.0:1787075983.239216:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a02c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.239231:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a02c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075983.239246:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:0.0:1787075983.239283:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:0.0:1787075983.239296:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+44:2362:x1873884678805120:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075983.239314:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075983.239344:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840a00/0x859911ad686a02b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623712 expref: 45 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.239369:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:0.0:1787075983.239375:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075983.239444:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+45:2362:x1873884678805120:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 150us (828us total) trans 0 rc 0/0 00010000:00010000:3.0:1787075983.239447:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a02be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623719 expref: 45 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075983.239467:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00010000:00010000:3.0:1787075983.239483:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a02c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623719 expref: 44 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.239517:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:3.0:1787075983.239521:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787075983.239524:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523600, rc 0) 00000100:00100000:3.0:1787075983.240694:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+43:11570:x1873884678805376:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1707us (1944us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1787075983.240708:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 202 00010000:00010000:2.0:1787075983.252790:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075983.256994:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075983.257191:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678805504 00000100:00100000:3.0:1787075983.257205:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678805504 00000100:00100000:3.0:1787075983.257291:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:3.0:1787075983.257304:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+6:2360:x1873884678805504:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1787075983.257371:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b12216a/0x859911ad686a02d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.257403:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000598af6be/0x859911ad686a0294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623704 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.257414:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787075983.257419:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787075983.257424:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b12216a/0x859911ad686a02d3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.257480:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000598af6be/0x859911ad686a0294 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623704 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.257497:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000598af6be/0x859911ad686a0294 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623704 expref: 6 pid: 6706 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075983.257537:0:6704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1873884700813184:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787075983.257837:0:6704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf62ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787075983.261236:0:6704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1873884700813184:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075983.261273:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004b12216a/0x859911ad686a02d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075983.268112:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075983.268245:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678805632 00000100:00100000:1.0:1787075983.268265:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678805632 00002000:00100000:1.0:1787075983.268351:0:6711:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9961b94ba300 x1873884678805632/t0(0) o4->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:54/0 lens 504/0 e 0 to 0 dl 1787075994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787075983.268365:0:6711:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961b94ba300 with x1873884678805632 ext(0->8) 00010000:00010000:1.0:1787075983.268380:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000598af6be/0x859911ad686a0294 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623704 expref: 7 pid: 6706 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.268403:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000598af6be/0x859911ad686a0294 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623704 expref: 7 pid: 6706 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787075983.268413:0:6711:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9961b94ba300 00000100:00100000:1.0:1787075983.268466:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:1.0:1787075983.268479:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2362:x1873884678805632:12345-192.168.204.50@tcp:4:lfs.0 00000100:00100000:1.0:1787075983.269514:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:2362:x1873884678805632:12345-192.168.204.50@tcp:4:lfs.0 Request processed in 1031us (1407us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787075983.269526:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3 00002000:00100000:1.0:1787075983.269534:0:6711:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9961b94ba300 x1873884678805632/t4294967308(0) o4->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:54/0 lens 504/448 e 0 to 0 dl 1787075994 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787075983.269562:0:6711:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961b94ba300 with x1873884678805632 ext(0->8) 00010000:00010000:1.0:1787075983.269572:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000598af6be/0x859911ad686a0294 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623704 expref: 9 pid: 6706 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.269590:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000598af6be/0x859911ad686a0294 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623704 expref: 9 pid: 6706 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787075983.269598:0:6711:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9961b94ba300 00000100:00100000:0.0:1787075983.277073:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075983.277199:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678805760 00000100:00100000:2.0:1787075983.277215:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678805760 00010000:00010000:2.0:1787075983.277263:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000598af6be/0x859911ad686a0294 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623704 expref: 9 pid: 6706 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075983.277318:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:2.0:1787075983.277328:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:2359:x1873884678805760:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075983.277343:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787075983.277380:0:8465:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787075983.277383:0:8465:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787075983 00002000:00010000:2.0:1787075983.277386:0:8465:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787075983 00002000:00010000:2.0:1787075983.277389:0:8465:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787075983 00010000:00010000:2.0:1787075983.277399:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000598af6be/0x859911ad686a0294 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623704 expref: 9 pid: 6706 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.277414:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000598af6be/0x859911ad686a0294 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623704 expref: 9 pid: 6706 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.277438:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000598af6be/0x859911ad686a0294 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623704 expref: 9 pid: 6706 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.277453:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787075983.277458:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787075983.277463:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004b12216a/0x859911ad686a02d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.277473:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b12216a/0x859911ad686a02d3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.277509:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075983.277576:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2359:x1873884678805760:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 249us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075983.277584:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 75 00010000:00010000:3.0:1787075983.277794:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004b12216a/0x859911ad686a02d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.277804:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b12216a/0x859911ad686a02d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.277835:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b12216a/0x859911ad686a02d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.277843:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b12216a/0x859911ad686a02d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.277851:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b12216a/0x859911ad686a02d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.277858:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522c00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787075983.277862:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b12216a/0x859911ad686a02d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.277885:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b12216a/0x859911ad686a02d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.277897:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b12216a/0x859911ad686a02d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.277904:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b12216a/0x859911ad686a02d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075983.278138:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2360:x1873884678805504:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 20835us (21161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075983.278148:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:0.0:1787075983.292368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075983.292487:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678806016 00000100:00100000:2.0:1787075983.292507:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678806016 00000100:00100000:2.0:1787075983.292621:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:2.0:1787075983.292719:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b0115450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+43:11570:x1873884678806016:12345-192.168.204.50@tcp:35:lfs.0 00000004:00010000:2.0:1787075983.292828:0:5855:0:(mdt_open.c:1970:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a02c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623719 expref: 43 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787075983.293236:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1787075983.293287:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1787075983.293708:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:3.0:1787075983.293948:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a02da lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.293987:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841a00/0x859911ad686a027f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236f6 expref: 47 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.293998:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a02da lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.294063:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841a00/0x859911ad686a027f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236f6 expref: 47 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.294085:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841a00/0x859911ad686a027f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236f6 expref: 47 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075983.294128:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1873884700813312:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787075983.294258:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961874a8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787075983.298625:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075983.298748:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678806144 00000100:00100000:0.0:1787075983.298766:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678806144 00010000:00010000:0.0:1787075983.298827:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841a00/0x859911ad686a027f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236f6 expref: 48 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075983.298892:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 76 00000100:00100000:0.0:1787075983.298903:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+48:2361:x1873884678806144:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075983.298920:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075983.298928:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841a00/0x859911ad686a027f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236f6 expref: 48 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.298942:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841a00/0x859911ad686a027f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236f6 expref: 48 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.298966:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:3.0:1787075983.299083:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841a00/0x859911ad686a027f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236f6 expref: 48 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075983.299114:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1873884700813312:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787075983.299344:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a02da lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.299359:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a02da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.299367:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a02da lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.299419:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a02da lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.299517:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787075983.299631:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a02da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075983.299692:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+47:2361:x1873884678806144:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 787us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075983.299704:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 76 00010000:00010000:3.0:1787075983.299808:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a02da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787075983.300030:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1787075983.303348:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1787075983.303551:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1873884700813440:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787075983.303711:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075983.303770:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961893616c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075983.304726:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700813440 00000100:00100000:0.0:1787075983.304748:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700813440 00000100:00100000:0.0:1787075983.304838:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787075983.304848:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1873884700813440:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787075983.305049:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1873884700813440:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 201us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075983.305057:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787075983.305345:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1873884700813440:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787075983.306158:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1787075983.306299:0:5855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bec09f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1873884700813568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787075983.307004:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075983.307132:0:5855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961879409c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075983.309269:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700813568 00000100:00100000:0.0:1787075983.309289:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700813568 00000100:00100000:1.0:1787075983.309624:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787075983.309685:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1873884700813568:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787075983.310134:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5855:x1873884700813568:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 496us (3130us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787075983.310143:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787075983.311461:0:5855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bec09f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1873884700813568:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787075983.311583:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1787075983.311721:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a02da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.311734:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a02da lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.311743:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a02da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.311750:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075983.311755:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a02da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.311763:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a02da lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.311780:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:2.0:1787075983.311784:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787075983.311788:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a02da lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.311796:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a02da lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787075983.312348:0:5855:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787075983.312484:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1787075983.312497:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365287856490ns, next at 366287853876ns, rc = 0 00000001:00080000:2.0:1787075983.312507:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1787075983.312554:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:2.0:1787075983.312557:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787075983.312565:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a02c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623719 expref: 51 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075983.312780:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b0115450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+50:11570:x1873884678806016:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 20062us (20432us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787075983.312792:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 56 00000020:00080000:2.0:1787075983.312799:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787075983.326247:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075983.326456:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678806272 00000100:00100000:2.0:1787075983.326472:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678806272 00000100:00100000:2.0:1787075983.326555:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 203 00000100:00100000:2.0:1787075983.326565:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+50:11570:x1873884678806272:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787075983.326591:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075983.326617:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a02e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623720 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.326745:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a02e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623720 expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.326761:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a02e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623720 expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.326802:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:2.0:1787075983.326805:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787075983.326809:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1841e00, rc 0) 00000100:00100000:2.0:1787075983.326878:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+51:11570:x1873884678806272:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 314us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075983.326885:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 203 00000100:00100000:1.0:1787075983.348910:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075983.349160:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678806528 00000100:00100000:0.0:1787075983.349171:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678806528 00000100:00100000:0.0:1787075983.349235:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:0.0:1787075983.349247:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+51:11570:x1873884678806528:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1787075983.349539:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:11570:x1873884678806528:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 292us (640us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1787075983.349548:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:0.0:1787075983.463776:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075983.464030:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678806656 00000100:00100000:1.0:1787075983.464040:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678806656 00000100:00100000:1.0:1787075983.464100:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 204 00000100:00100000:1.0:1787075983.464110:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:11580:x1873884678806656:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:1.0:1787075983.464215:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a02e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464234:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a02e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464246:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a02e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464262:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a02ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464269:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a02ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464275:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a02ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464391:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad686a02f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464400:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad686a02f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464407:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad686a02f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787075983.464450:0:7654:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad686a02f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464463:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a02e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464480:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a02e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464486:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a02e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464493:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075983.464498:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a02e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464506:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a02e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464517:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:1.0:1787075983.464520:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075983.464525:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a02e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464532:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a02e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464547:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a02ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464553:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a02ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464558:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a02ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464563:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075983.464572:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a02ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464578:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a02ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464585:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996187c34800) 00010000:00010000:1.0:1787075983.464587:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075983.464589:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a02ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464595:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a02ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464608:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad686a02f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464613:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad686a02f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464618:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad686a02f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464623:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075983.464625:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad686a02f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464630:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad686a02f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464636:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:1.0:1787075983.464698:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075983.464708:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad686a02f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.464714:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632400/0x859911ad686a02f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075983.464799:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:11580:x1873884678806656:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 689us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075983.464808:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 204 00000100:00100000:3.0:1787075983.524766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075983.525336:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678806912 00000100:00100000:2.0:1787075983.525351:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678806912 00000100:00100000:2.0:1787075983.525603:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 205 00000100:00100000:2.0:1787075983.525617:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+52:11583:x1873884678806912:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787075983.525680:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075983.525708:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a02fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623727 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.525866:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0304 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526025:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0304 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526042:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0304 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526063:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a030b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526071:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a030b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526091:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a030b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526296:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0312 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526306:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526313:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075983.526326:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787075983.526470:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0304 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526479:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0304 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526487:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0304 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526495:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075983.526499:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0304 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526508:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0304 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526522:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:2.0:1787075983.526526:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075983.526539:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0304 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526547:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0304 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526564:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a030b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526570:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a030b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526576:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a030b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526581:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075983.526584:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a030b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526590:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a030b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526598:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99619211c700) 00010000:00010000:2.0:1787075983.526601:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075983.526604:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a030b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526610:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a030b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526727:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a02fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623727 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526755:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623727 expref: 54 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.526763:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:2.0:1787075983.526765:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787075983.526768:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1840e00, rc 0) 00000100:00100000:2.0:1787075983.527553:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+54:11583:x1873884678806912:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1934us (2797us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787075983.527568:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 205 00000100:00100000:3.0:1787075983.533181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075983.533308:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678807040 00000100:00100000:1.0:1787075983.533324:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678807040 00000100:00100000:1.0:1787075983.533413:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 206 00000100:00100000:1.0:1787075983.533429:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+54:11583:x1873884678807040:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:1.0:1787075983.533815:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a0320 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.533840:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a0320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.533854:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a0320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.533898:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a0320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.533905:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a0320 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.533913:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a0320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.533920:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075983.533944:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a0320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.533953:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a0320 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.533968:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:1.0:1787075983.533971:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787075983.533977:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a0320 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.533983:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a0320 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075983.534101:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+54:11583:x1873884678807040:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 677us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075983.534111:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 206 00000100:00100000:1.0:1787075983.539306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075983.539459:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678807296 00000100:00100000:0.0:1787075983.539474:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678807296 00000100:00100000:0.0:1787075983.539617:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:0.0:1787075983.539631:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+54:11583:x1873884678807296:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1787075983.540157:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:11583:x1873884678807296:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 522us (962us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787075983.540167:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:0.0:1787075983.627840:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075983.628235:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678807552 00000100:00100000:3.0:1787075983.628249:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678807552 00000100:00100000:3.0:1787075983.628694:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 207 00000100:00100000:3.0:1787075983.628713:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:11593:x1873884678807552:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787075983.628774:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075983.628779:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787075983.628822:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a02a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762370b expref: 55 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.628863:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:3.0:1787075983.628870:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787075983.628897:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0327 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762372e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.629037:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a032e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.629054:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0312 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623727 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.629063:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a032e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.629108:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623727 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.629124:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0312 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623727 expref: 55 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075983.629141:0:5853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1873884700813696:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787075983.629804:0:5853:0:(client.c:2702:ptlrpc_set_wait()) set ffff996189361240 going to sleep for 11 seconds 00000100:00100000:3.0:1787075983.634604:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075983.634980:0:5853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1873884700813696:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787075983.635027:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a032e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075983.635163:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678807680 00000100:00100000:0.0:1787075983.635173:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678807680 00010000:00010000:0.0:1787075983.635455:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0312 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623727 expref: 56 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075983.635547:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:0.0:1787075983.635569:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+56:2362:x1873884678807680:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075983.635589:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075983.635599:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0312 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623727 expref: 56 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.635612:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623727 expref: 56 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.635681:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0312 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623727 expref: 56 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.635702:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:0.0:1787075983.635707:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a032e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.635719:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a032e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.635728:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a032e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.635762:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075983.635847:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:2362:x1873884678807680:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 279us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075983.635855:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 77 00010000:00010000:3.0:1787075983.635946:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a032e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.635955:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a032e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075983.635979:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787075983.636179:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0327 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762372e expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.636198:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a032e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762372e expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.636218:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:3.0:1787075983.636222:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787075983.636224:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523000, rc 0) 00000100:00100000:3.0:1787075983.636257:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:11593:x1873884678807552:12345-192.168.204.50@tcp:101:bash.0 Request processed in 7551us (8437us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1787075983.636265:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 207 00000100:00100000:1.0:1787075983.642027:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075983.642508:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678807936 00000100:00100000:2.0:1787075983.642524:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678807936 00000100:00100000:2.0:1787075983.642609:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 208 00000100:00100000:2.0:1787075983.642622:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+55:11593:x1873884678807936:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:2.0:1787075983.643509:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a033c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.643544:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a033c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.643561:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a033c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787075983.643631:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:2.0:1787075983.644030:0:7654:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000767bcc1d reply state 000000002acb12cf transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a033c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075983.644042:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787075983.644187:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+58:11593:x1873884678807936:12345-192.168.204.50@tcp:36:bash.0 Request processed in 1564us (2171us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787075983.644197:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 208 00000020:00080000:2.0:1787075983.645499:0:7654:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787075983.652008:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a033c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.652032:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a033c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.652061:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a033c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.652067:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075983.652073:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a033c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.652081:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a033c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.652102:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:0.0:1787075983.652105:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075983.652111:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a033c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.652118:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a033c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075983.653580:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075983.653965:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678808064 00000100:00100000:2.0:1787075983.653981:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678808064 00000100:00100000:2.0:1787075983.654065:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 209 00000100:00100000:2.0:1787075983.654074:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+57:11593:x1873884678808064:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1787075983.654107:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075983.654135:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a0343 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623735 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.654315:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a034a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.654336:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a032e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762372e expref: 58 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.654346:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a034a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.654388:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a032e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762372e expref: 58 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.654776:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a032e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762372e expref: 58 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075983.654831:0:5852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1873884700813824:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787075983.654983:0:5852:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961bf616f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787075983.659552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075983.659628:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678808192 00000100:00100000:0.0:1787075983.659672:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678808192 00010000:00010000:0.0:1787075983.659726:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a032e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762372e expref: 59 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075983.659767:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:0.0:1787075983.659778:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+59:2361:x1873884678808192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075983.659803:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075983.659816:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a032e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762372e expref: 59 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.659855:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a032e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762372e expref: 59 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.659900:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:0.0:1787075983.659908:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a034a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.659920:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a034a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.659929:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a034a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075983.659959:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787075983.660094:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a032e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762372e expref: 59 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075983.660114:0:5852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1873884700813824:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787075983.660146:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a034a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.660156:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a034a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.660162:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a034a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075983.660229:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787075983.660235:0:5852:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787075983.660258:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a034a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.660298:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a0343 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623735 expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.660314:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a034a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623735 expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.660322:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:2.0:1787075983.660333:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787075983.660336:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1841600, rc 0) 00000100:00100000:0.0:1787075983.661838:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+58:2361:x1873884678808192:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2048us (2289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075983.661856:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:2.0:1787075983.662128:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+57:11593:x1873884678808064:12345-192.168.204.50@tcp:101:bash.0 Request processed in 8050us (8560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075983.662138:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 209 00000100:00100000:3.0:1787075983.668092:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075983.668186:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678808448 00000100:00100000:2.0:1787075983.668201:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678808448 00000100:00100000:2.0:1787075983.668290:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:2.0:1787075983.668305:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+57:11593:x1873884678808448:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:2.0:1787075983.669092:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+58:11593:x1873884678808448:12345-192.168.204.50@tcp:35:bash.0 Request processed in 787us (1013us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787075983.669105:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:1.0:1787075983.749169:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075983.749341:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678808576 00000100:00100000:3.0:1787075983.749355:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678808576 00000100:00100000:3.0:1787075983.749437:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 210 00000100:00100000:3.0:1787075983.749450:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+58:11600:x1873884678808576:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787075983.749483:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075983.749512:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a0351 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762373c expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.749629:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0358 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.749709:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.749726:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075983.749981:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787075983.749987:0:5854:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787075983.750022:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.750058:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a0351 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762373c expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.750087:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0358 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762373c expref: 59 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.750097:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:3.0:1787075983.750100:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787075983.750105:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522c00, rc 0) 00000100:00100000:3.0:1787075983.750361:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+59:11600:x1873884678808576:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 913us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075983.750371:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 210 00000100:00100000:1.0:1787075983.764601:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075983.765255:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678808704 00000100:00100000:3.0:1787075983.765270:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678808704 00000100:00100000:3.0:1787075983.765375:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 211 00000100:00100000:3.0:1787075983.765388:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+59:11600:x1873884678808704:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787075983.765420:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075983.765451:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a035f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623743 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.765548:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0366 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.765567:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0366 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.765581:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0366 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.765600:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a036d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.765607:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a036d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.765615:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a036d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.765827:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0374 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.765837:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.765844:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075983.765903:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787075983.765908:0:5853:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787075983.765930:0:5853:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.765944:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.765953:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0366 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.765959:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0366 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.765967:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0366 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.765974:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075983.765978:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0366 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.765986:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0366 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.766002:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:3.0:1787075983.766006:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075983.766011:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0366 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.766018:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0366 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.766049:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a036d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.766055:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a036d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.766060:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a036d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.766065:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075983.766069:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a036d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.766075:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a036d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.766083:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996194304000) 00010000:00010000:3.0:1787075983.766085:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787075983.766088:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a036d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.766094:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a036d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.767074:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a035f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623743 expref: 61 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.767097:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0374 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623743 expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.767134:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:3.0:1787075983.767137:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787075983.767142:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522a00, rc 0) 00000100:00100000:2.0:1787075983.767857:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:11600:x1873884678808704:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2462us (3265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075983.767870:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 211 00000100:00100000:3.0:1787075983.772618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075983.772999:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075983.773092:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678809088 00000100:00100000:3.0:1787075983.773107:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678809088 00000100:00100000:3.0:1787075983.773337:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 212 00000100:00100000:3.0:1787075983.773350:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:11600:x1873884678809088:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787075983.773380:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075983.773408:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a037b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762374a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.773552:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.773572:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a034a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623735 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.773582:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0374 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623743 expref: 61 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.773591:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.773636:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0374 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623743 expref: 61 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.773717:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0374 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623743 expref: 61 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075983.773735:0:5854:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1873884700813952:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787075983.773950:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678808832 00000100:00100000:2.0:1787075983.773958:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678808832 00010000:00010000:2.0:1787075983.773992:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0374 lrc: 6/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623743 expref: 62 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075983.774034:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:2.0:1787075983.774044:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+62:2361:x1873884678808832:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075983.774057:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075983.774065:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0374 lrc: 6/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623743 expref: 62 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.774078:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0374 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623743 expref: 62 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.774110:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:2.0:1787075983.774114:0:8465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.774135:0:8465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.774143:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075983.774193:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+62:2361:x1873884678808832:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 150us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075983.774324:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 79 00010000:00010000:2.0:1787075983.777758:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a034a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623735 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.777789:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a034a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623735 expref: 61 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075983.779060:0:5854:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1873884700814080:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787075983.779612:0:5854:0:(client.c:2702:ptlrpc_set_wait()) set ffff996189361a80 going to sleep for 11 seconds 00010000:00010000:2.0:1787075983.783009:0:5854:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@0000000047bfe2ca x1873884700813952) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0374 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623743 expref: 61 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.783047:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522a00/0x859911ad686a0374 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623743 expref: 61 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075983.783071:0:5854:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1873884700813952:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787075983.790594:0:5854:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1873884700814080:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787075983.790685:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:2.0:1787075983.790695:0:5854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.790710:0:5854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.790722:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075983.793943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075983.795164:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678809216 00000100:00100000:0.0:1787075983.795443:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678809216 00010000:00010000:2.0:1787075983.795694:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a034a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623735 expref: 61 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075983.795764:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 80 00000100:00100000:2.0:1787075983.795778:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a0262c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+61:2362:x1873884678809216:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075983.795801:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075983.795811:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a034a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623735 expref: 61 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.795828:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a034a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623735 expref: 61 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.795858:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a034a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623735 expref: 61 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.795879:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:2.0:1787075983.795904:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.795917:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.795926:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.796279:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075983.796371:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a0262c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:2362:x1873884678809216:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 594us (2442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075983.796381:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 80 00010000:00010000:3.0:1787075983.796933:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075983.796946:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075983.796977:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787075983.798523:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a037b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762374a expref: 61 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.798557:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762374a expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.798567:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:2.0:1787075983.798570:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787075983.798575:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523000, rc 0) 00000100:00100000:2.0:1787075983.798700:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:11600:x1873884678809088:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 25351us (25700us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1787075983.798711:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 212 00000100:00100000:3.0:1787075983.801692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075983.801916:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678809472 00000100:00100000:2.0:1787075983.801930:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678809472 00000100:00100000:2.0:1787075983.802022:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:2.0:1787075983.802034:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:11600:x1873884678809472:12345-192.168.204.50@tcp:103:lfs.0 00010000:00010000:2.0:1787075983.802078:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075983.802113:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a02e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623720 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.802137:0:8465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:2.0:1787075983.802142:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075983.802233:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+59:11600:x1873884678809472:12345-192.168.204.50@tcp:103:lfs.0 Request processed in 200us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075983.802241:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:3.0:1787075983.805018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075983.809061:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678809600 00000100:00100000:2.0:1787075983.809085:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678809600 00000100:00100000:2.0:1787075983.809204:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 213 00000100:00100000:2.0:1787075983.809219:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+59:11600:x1873884678809600:12345-192.168.204.50@tcp:58:lfs.0 00010000:00010000:2.0:1787075983.809370:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0390 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.809406:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0390 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075983.809422:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0390 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787075983.809739:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787075983.809888:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+59:11600:x1873884678809600:12345-192.168.204.50@tcp:58:lfs.0 Request processed in 670us (4883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075983.809898:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 213 00000100:00100000:3.0:1787075983.813392:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075983.813515:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678809728 00000100:00100000:1.0:1787075983.813531:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678809728 00000100:00100000:1.0:1787075983.813703:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 214 00000100:00100000:1.0:1787075983.813715:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+59:11600:x1873884678809728:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787075983.813743:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075983.813770:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad686a0397 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623751 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.813871:0:7654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0390 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.813885:0:7654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad686a0397 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623751 expref: 60 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.813910:0:7654:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0390 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.813939:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad686a0397 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623751 expref: 60 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.813955:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:1.0:1787075983.813958:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787075983.813962:0:7654:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad686a0397 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623751 expref: 60 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075983.813970:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632a00, rc 0) 00000100:00100000:1.0:1787075983.814049:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:11600:x1873884678809728:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 336us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075983.814056:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 214 00000040:00080000:3.0:1787075984.086970:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787075984.086982:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787075984.087259:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787075984.087332:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787075984.087947:0:11694:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e07800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1873884700814208:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787075984.088479:0:11694:0:(client.c:2702:ptlrpc_set_wait()) set ffff996189361cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787075984.097146:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075984.097457:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678809856 00000100:00100000:0.0:1787075984.097473:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678809856 00000100:00100000:0.0:1787075984.097581:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 215 00000100:00100000:0.0:1787075984.097596:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+61:11601:x1873884678809856:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787075984.097751:0:5852:0:(mdt_handler.c:8026:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787075984.097931:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+61:11601:x1873884678809856:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 340us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075984.097940:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 215 00000100:00080000:1.0:1787075984.098327:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787075984.098605:0:11694:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e07800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1873884700814208:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787075984.107345:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075984.108028:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678809984 00000100:00100000:2.0:1787075984.108077:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678809984 00000100:00100000:2.0:1787075984.108238:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 216 00000100:00100000:2.0:1787075984.108251:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:11601:x1873884678809984:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787075984.108545:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a039e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.108569:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a039e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.108586:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a039e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.108607:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03a5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.108615:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.108621:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.108699:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840200/0x859911ad686a03ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.108709:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840200/0x859911ad686a03ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.108718:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840200/0x859911ad686a03ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075984.108772:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787075984.108777:0:5854:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787075984.108808:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840200/0x859911ad686a03ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.108823:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a039e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.108830:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a039e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.108837:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a039e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.108844:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841e00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075984.108849:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a039e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.113017:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a039e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.113048:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996191b79600) 00010000:00010000:2.0:1787075984.113052:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075984.113060:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a039e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.113069:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a039e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.113096:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.113104:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03a5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.113111:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.113147:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075984.113152:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.113158:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03a5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.113167:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff99619211c700) 00010000:00010000:2.0:1787075984.113169:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075984.113172:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03a5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.113178:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03a5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.113202:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840200/0x859911ad686a03ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.113209:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840200/0x859911ad686a03ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.113215:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840200/0x859911ad686a03ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.113220:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075984.113223:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840200/0x859911ad686a03ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.113230:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840200/0x859911ad686a03ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.113249:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:2.0:1787075984.113252:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075984.113255:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840200/0x859911ad686a03ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.113262:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840200/0x859911ad686a03ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075984.113423:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:11601:x1873884678809984:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 Request processed in 5168us (7034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075984.113438:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 216 00000100:00100000:3.0:1787075984.119491:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075984.119585:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678810240 00000100:00100000:0.0:1787075984.119601:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678810240 00000100:00100000:0.0:1787075984.119733:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 217 00000100:00100000:0.0:1787075984.119747:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+60:11601:x1873884678810240:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787075984.119777:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075984.119808:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a03b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623758 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.119955:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a03ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.119975:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a03ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.119991:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a03ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075984.120003:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787075984.120143:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a03ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.120151:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a03ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.120158:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a03ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.120164:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69e00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075984.120169:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a03ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.120198:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a03ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.120214:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:0.0:1787075984.120217:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787075984.120222:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a03ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.120228:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69e00/0x859911ad686a03ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.125612:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a03b3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623758 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.125668:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996191b79600) 00010000:00010000:0.0:1787075984.125673:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787075984.125679:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a03b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623758 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.125706:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe69c00, rc 0) 00000100:00100000:0.0:1787075984.125844:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+61:11601:x1873884678810240:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 6097us (6366us total) trans 4294967504 rc 301/301 00000100:00100000:0.0:1787075984.125859:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 217 00000100:00100000:1.0:1787075984.134082:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075984.134185:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678810368 00000100:00100000:2.0:1787075984.134199:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678810368 00000100:00100000:2.0:1787075984.134276:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 218 00000100:00100000:2.0:1787075984.134300:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+61:11601:x1873884678810368:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787075984.134354:0:7654:0:(mdt_handler.c:8026:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787075984.134512:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+61:11601:x1873884678810368:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 225us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075984.134521:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 218 00000100:00100000:1.0:1787075984.146775:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075984.147160:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678810624 00000100:00100000:3.0:1787075984.147176:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678810624 00000100:00100000:0.0:1787075984.147481:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 219 00000100:00100000:0.0:1787075984.147497:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+61:11601:x1873884678810624:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787075984.147527:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075984.147532:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787075984.147588:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522c00/0x859911ad686a0358 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762373c expref: 61 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.147613:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:0.0:1787075984.147619:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787075984.147637:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad686a03c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762375f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787075984.153571:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1787075984.156527:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840200/0x859911ad686a03cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.156569:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840200/0x859911ad686a03cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.156590:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840200/0x859911ad686a03cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.156809:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68800/0x859911ad686a03c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762375f expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.156844:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840200/0x859911ad686a03cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762375f expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.156854:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99619211c700) 00010000:00010000:2.0:1787075984.156858:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787075984.156863:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1840200, rc 0) 00000100:00100000:2.0:1787075984.156981:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+62:11601:x1873884678810624:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 9487us (10222us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787075984.156992:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 219 00000100:00100000:1.0:1787075984.161730:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075984.162116:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678810880 00000100:00100000:2.0:1787075984.162130:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678810880 00000100:00100000:2.0:1787075984.162221:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 220 00000100:00100000:2.0:1787075984.162234:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+62:11601:x1873884678810880:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787075984.164383:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075984.164441:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840200/0x859911ad686a03cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762375f expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164471:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99619211c700) 00010000:00010000:2.0:1787075984.164486:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787075984.164518:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164534:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164569:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164589:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x8c0197b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164596:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8c0197b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164603:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8c0197b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164768:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164777:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164784:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164792:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075984.164797:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164806:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164815:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:2.0:1787075984.164818:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075984.164822:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164855:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a03dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164865:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8c0197b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164871:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8c0197b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164876:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8c0197b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164882:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841e00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787075984.164886:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8c0197b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164892:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8c0197b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164900:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x8c0197b4 (ffff99619211cf00) 00010000:00010000:2.0:1787075984.164903:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787075984.164906:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8c0197b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.164912:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8c0197b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075984.165043:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+61:11601:x1873884678810880:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 2809us (3327us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787075984.165055:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 220 00000100:00100000:1.0:1787075984.170484:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075984.171144:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678811008 00000100:00100000:3.0:1787075984.171164:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678811008 00000100:00100000:3.0:1787075984.171518:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 221 00000100:00100000:3.0:1787075984.171534:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+61:11601:x1873884678811008:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787075984.171574:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075984.171621:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a03eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623766 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.171719:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a03f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.171736:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a03f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.171751:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a03f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.174633:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a03eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623766 expref: 63 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.174723:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a03f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623766 expref: 62 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.174734:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996194304000) 00010000:00010000:3.0:1787075984.174738:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787075984.174743:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523400, rc 0) 00000100:00100000:3.0:1787075984.174873:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+62:11601:x1873884678811008:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 3341us (4614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075984.174885:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 221 00000100:00100000:1.0:1787075984.182164:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075984.182533:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678811264 00000100:00100000:2.0:1787075984.182552:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678811264 00000100:00100000:2.0:1787075984.182695:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 222 00000100:00100000:2.0:1787075984.182708:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+62:11601:x1873884678811264:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787075984.183043:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.183130:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.183148:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787075984.185565:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1787075984.185601:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366160960525ns, next at 367160953868ns, rc = 0 00000004:00010000:2.0:1787075984.186216:0:7654:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 000000005e858edb reply state 0000000023998f2b transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075984.186234:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787075984.186440:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+64:11601:x1873884678811264:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 3729us (4288us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787075984.186451:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 222 00000100:00100000:1.0:1787075984.195145:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075984.195445:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678811392 00000100:00100000:0.0:1787075984.195461:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678811392 00000100:00100000:0.0:1787075984.195557:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 223 00000100:00100000:0.0:1787075984.195573:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+64:11601:x1873884678811392:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787075984.195616:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075984.195680:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0400 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762376d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.195779:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0400 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762376d expref: 65 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.195800:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0400 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762376d expref: 65 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.195826:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996194304000) 00010000:00010000:0.0:1787075984.195830:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787075984.195836:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe69c00, rc 0) 00000100:00100000:0.0:1787075984.195933:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+65:11601:x1873884678811392:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 365us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075984.195962:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 223 00010000:00010000:3.0:1787075984.196891:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.196922:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.196931:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.196937:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841e00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075984.196943:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.196951:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.196970:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996194304000) 00010000:00010000:3.0:1787075984.196973:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787075984.196977:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.196983:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a03f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075984.201548:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075984.202146:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678811520 00000100:00100000:2.0:1787075984.202161:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678811520 00000100:00100000:2.0:1787075984.202314:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:2.0:1787075984.202332:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:2362:x1873884678811520:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787075984.203218:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+10:2362:x1873884678811520:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 886us (1681us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787075984.203232:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:0.0:1787075984.206972:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075984.207202:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678811776 00000100:00100000:2.0:1787075984.207215:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678811776 00000100:00100000:2.0:1787075984.207308:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:2.0:1787075984.207321:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+64:11601:x1873884678811776:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787075984.208311:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+65:11601:x1873884678811776:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 985us (1352us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787075984.208324:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00080000:1.0:1787075984.209074:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787075984.213222:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075984.213436:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678812032 00000100:00100000:2.0:1787075984.213451:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678812032 00000100:00100000:2.0:1787075984.213536:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 224 00000100:00100000:2.0:1787075984.213550:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+65:11601:x1873884678812032:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787075984.213769:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+65:11601:x1873884678812032:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 221us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075984.213778:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 224 00000100:00100000:2.0:1787075984.221468:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075984.221702:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678812160 00000100:00100000:0.0:1787075984.221715:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678812160 00000100:00100000:0.0:1787075984.221869:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 225 00000100:00100000:0.0:1787075984.221881:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+65:11601:x1873884678812160:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787075984.221911:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787075984.221941:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69600/0x859911ad686a0407 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623774 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.222040:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad686a040e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.222069:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad686a040e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.222084:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad686a040e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787075984.222137:0:5852:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787075984.222162:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad686a040e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.222195:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69600/0x859911ad686a0407 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623774 expref: 67 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.222222:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad686a040e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623774 expref: 66 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.222275:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996194304000) 00010000:00010000:0.0:1787075984.222279:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787075984.222284:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe69400, rc 0) 00000100:00100000:0.0:1787075984.222375:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+66:11601:x1873884678812160:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 495us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075984.223037:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 225 00000100:00100000:2.0:1787075984.226790:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075984.227186:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678812288 00000100:00100000:3.0:1787075984.227200:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678812288 00000100:00100000:3.0:1787075984.227294:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:3.0:1787075984.227306:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+10:2361:x1873884678812288:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787075984.227334:0:8477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075984.227363:0:8477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039a58a4e/0x859911ad686a0415 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762377b expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787075984.227952:0:8477:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a849d90, blocks: 0x1 00010000:00010000:2.0:1787075984.227987:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=366s v=(0 0) 00010000:00010000:2.0:1787075984.227993:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787075984.228009:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039a58a4e/0x859911ad686a0415 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762377b expref: 11 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.228032:0:8477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039a58a4e/0x859911ad686a0415 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762377b expref: 11 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.228048:0:8477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523600, rc 0) 00000100:00100000:2.0:1787075984.228151:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+11:2361:x1873884678812288:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 847us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075984.228160:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:3.0:1787075984.232625:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075984.233360:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678812544 00000100:00100000:2.0:1787075984.233377:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678812544 00000100:00100000:2.0:1787075984.233472:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 226 00000100:00100000:2.0:1787075984.233484:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961becb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+66:11601:x1873884678812544:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787075984.233698:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961becb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+66:11601:x1873884678812544:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 216us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075984.233707:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 226 00000100:00100000:2.0:1787075984.237982:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075984.238197:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678812672 00000100:00100000:3.0:1787075984.238210:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678812672 00000100:00100000:3.0:1787075984.238291:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:3.0:1787075984.238303:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+11:11601:x1873884678812672:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787075984.238327:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075984.238352:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1dd847c/0x859911ad686a041c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623782 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.238410:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039a58a4e/0x859911ad686a0415 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762377b expref: 12 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.238421:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787075984.238426:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787075984.238433:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1dd847c/0x859911ad686a041c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623782 expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.238483:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039a58a4e/0x859911ad686a0415 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762377b expref: 12 pid: 8477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.238500:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039a58a4e/0x859911ad686a0415 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762377b expref: 12 pid: 8477 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075984.238516:0:6706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf757b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1873884700814336:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787075984.239099:0:6706:0:(client.c:2702:ptlrpc_set_wait()) set ffff996189361cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075984.245714:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075984.245838:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678812800 00000100:00100000:1.0:1787075984.245860:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678812800 00010000:00010000:1.0:1787075984.245935:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039a58a4e/0x859911ad686a0415 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762377b expref: 13 pid: 8477 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075984.245997:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00100000:1.0:1787075984.246011:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:2362:x1873884678812800:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787075984.246034:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075984.246199:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039a58a4e/0x859911ad686a0415 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762377b expref: 13 pid: 8477 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.246217:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039a58a4e/0x859911ad686a0415 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762377b expref: 13 pid: 8477 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.246252:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787075984.246269:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787075984.246279:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1dd847c/0x859911ad686a041c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623782 expref: 13 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.246292:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1dd847c/0x859911ad686a041c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623782 expref: 13 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.246342:0:5838:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b1dd847c/0x859911ad686a041c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623782 expref: 13 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075984.246524:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f54700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5838:1873884700814464:192.168.204.50@tcp:105: 00000100:00100000:1.0:1787075984.246762:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187940300 going to sleep for 11 seconds 00010000:00010000:3.0:1787075984.248217:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039a58a4e/0x859911ad686a0415 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762377b expref: 13 pid: 8477 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075984.248250:0:6706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf757b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1873884700814336:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075984.250347:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1dd847c/0x859911ad686a041c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623782 expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.250378:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522200, rc 0) 00000100:00100000:3.0:1787075984.250613:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+12:11601:x1873884678812672:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 12310us (12643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075984.250625:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:1.0:1787075984.252233:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f54700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5838:1873884700814464:192.168.204.50@tcp:105: 00010000:00010000:1.0:1787075984.252279:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075984.252349:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+11:2362:x1873884678812800:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6340us (6652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075984.252364:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00100000:2.0:1787075984.259138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075984.259246:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678812928 00000100:00100000:0.0:1787075984.259367:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678812928 00002000:00100000:0.0:1787075984.259508:0:6709:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9961b52cbb80 x1873884678812928/t0(0) o4->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:55/0 lens 504/0 e 0 to 0 dl 1787075995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787075984.259521:0:6709:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961b52cbb80 with x1873884678812928 ext(0->12) 00002000:00010000:0.0:1787075984.259529:0:6709:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9961b52cbb80 00000100:00100000:0.0:1787075984.259616:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:0.0:1787075984.259628:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+11:2362:x1873884678812928:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787075984.260536:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:2362:x1873884678812928:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 Request processed in 903us (1407us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787075984.260548:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00002000:00100000:0.0:1787075984.260556:0:6709:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9961b52cbb80 x1873884678812928/t4294967320(0) o4->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:55/0 lens 504/448 e 0 to 0 dl 1787075995 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787075984.260566:0:6709:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961b52cbb80 with x1873884678812928 ext(0->12) 00002000:00010000:0.0:1787075984.260571:0:6709:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9961b52cbb80 00000100:00100000:3.0:1787075984.263928:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075984.264049:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678813056 00000100:00100000:2.0:1787075984.264076:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678813056 00000100:00100000:2.0:1787075984.264166:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 227 00000100:00100000:2.0:1787075984.264179:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+66:11601:x1873884678813056:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1787075984.264762:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075984.317586:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+66:11601:x1873884678813056:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 Request processed in 53389us (53655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075984.317605:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 227 00000001:00080000:0.0:1787075984.317748:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000020:00080000:0.0:1787075984.317823:0:5874:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff996187940900 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787075984.317828:0:5874:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9961bf071f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996187940c00 00000020:00080000:0.0:1787075984.317833:0:5874:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9961bf071200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9961a0351000 00000020:00080000:2.0:1787075984.317985:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000004:00080000:0.0:1787075984.318023:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000001:00080000:0.0:1787075984.318066:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:0.0:1787075984.318075:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1787075984.318095:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1787075984.318146:0:5874:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9961bf616180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787075984.318150:0:5874:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9961baedaf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff996185caa480 00000020:00080000:0.0:1787075984.318152:0:5874:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9961baedab00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9961bf74c800 00000020:00080000:0.0:1787075984.318168:0:5874:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:0.0:1787075984.318486:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787075984.318509:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b91bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700814592:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787075984.318594:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075984.318709:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700814592 00000100:00100000:0.0:1787075984.318720:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700814592 00000100:00100000:0.0:1787075984.318774:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787075984.318786:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1873884700814592:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787075984.319067:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700814720:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787075984.319111:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075984.319141:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787075984.319148:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700814848:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787075984.319171:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075984.319219:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700814720 00000100:00100000:2.0:1787075984.319224:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700814720 00002000:00080000:0.0:1787075984.319424:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1787075984.319480:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a849d8f, atime: 0x6a849d8f, ctime: 0x6a849d8f, blocks: 0x1 00010000:00010000:0.0:1787075984.319491:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad686a0423 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.319515:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1787075984.319522:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787075984.319529:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad686a0423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.319561:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad686a0423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.319574:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad686a0423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.319582:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad686a0423 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.319607:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787075984.319973:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700814848 00000100:00100000:2.0:1787075984.319979:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700814848 00000100:00100000:2.0:1787075984.319996:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787075984.320005:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1873884700814720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787075984.320023:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1787075984.320042:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014402ec5/0x859911ad686a042a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.320060:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba586150/0x859911ad686a01e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236e1 expref: 12 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.320069:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787075984.320072:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787075984.320076:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014402ec5/0x859911ad686a042a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.320110:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba586150/0x859911ad686a01e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236e1 expref: 12 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.320126:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba586150/0x859911ad686a01e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236e1 expref: 12 pid: 6704 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075984.320140:0:6705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1873884700814976:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787075984.320208:0:6705:0:(client.c:2702:ptlrpc_set_wait()) set ffff99619036b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787075984.325226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075984.326060:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075984.326111:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678813184 00000100:00100000:2.0:1787075984.326123:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678813184 00010000:00010000:2.0:1787075984.326478:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba586150/0x859911ad686a01e5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236e1 expref: 13 pid: 6704 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075984.326536:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:2.0:1787075984.326550:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:2360:x1873884678813184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075984.326570:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075984.326578:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba586150/0x859911ad686a01e5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236e1 expref: 13 pid: 6704 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.326597:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba586150/0x859911ad686a01e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236e1 expref: 13 pid: 6704 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.326636:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787075984.326674:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787075984.326681:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014402ec5/0x859911ad686a042a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.326693:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014402ec5/0x859911ad686a042a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.326722:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075984.326790:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+13:2360:x1873884678813184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 243us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075984.326799:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:3.0:1787075984.327382:0:6706:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787075984.327395:0:6706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:3.0:1787075984.327555:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba586150/0x859911ad686a01e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236e1 expref: 12 pid: 6704 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075984.327574:0:6705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1873884700814976:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075984.327609:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000014402ec5/0x859911ad686a042a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.327622:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000014402ec5/0x859911ad686a042a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.327698:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014402ec5/0x859911ad686a042a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.327711:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014402ec5/0x859911ad686a042a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.327721:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014402ec5/0x859911ad686a042a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.327742:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00080000:1.0:1787075984.329038:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787075984.329578:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3313:x1873884700814592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10786us (10975us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787075984.329593:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787075984.329630:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678813312 00000100:00100000:0.0:1787075984.329676:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678813312 00000100:00100000:0.0:1787075984.329711:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787075984.329720:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1873884700814848:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1787075984.330145:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9961b91bad80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787075984.330155:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b91bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700814592:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787075984.331381:0:12484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:2.0:1787075984.331400:0:12484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a850c61f-0242-4b36-8952-7b46dff1f2b9+12:2361:x1873884678813312:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 00002000:00010000:0.0:1787075984.331675:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787075984.331680:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787075984 00002000:00010000:0.0:1787075984.331682:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787075984.331685:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787075984 -> 1787075984 00002000:00010000:0.0:1787075984.331687:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787075984.332154:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3311:x1873884700814720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12147us (13039us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787075984.332166:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:3.0:1787075984.332206:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787075984.332218:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad686a0423 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.332234:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69800 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787075984.332240:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad686a0423 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.332253:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad686a0423 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.332426:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad686a0423 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.332444:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3c82af9/0x859911ad686a0423 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.332471:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787075984.332475:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014402ec5/0x859911ad686a042a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.332482:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841000 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787075984.332486:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014402ec5/0x859911ad686a042a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.332495:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014402ec5/0x859911ad686a042a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.332506:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014402ec5/0x859911ad686a042a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.332514:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014402ec5/0x859911ad686a042a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.332546:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787075984.332548:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787075984.332549:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787075984.332606:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9961b52c8000/2, rc 0, transno 4294967322 00000100:00100000:3.0:1787075984.332615:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700814720:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787075984.332772:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3311:x1873884700814848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3052us (13599us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787075984.332782:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1787075984.332824:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787075984.332839:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787075984.333063:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:3.0:1787075984.333220:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9961b52c9f80/2, rc 0, transno 4294967321 00000100:00100000:3.0:1787075984.333226:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700814848:0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1787075984.379782:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1787075984.379875:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:0.0:1787075984.379902:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:2.0:1787075984.380190:0:12484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2361:x1873884678813312:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 Request processed in 48788us (54122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075984.380206:0:12484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:3.0:1787075984.383525:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075984.383748:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678813568 00000100:00100000:0.0:1787075984.383761:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678813568 00000100:00100000:0.0:1787075984.383846:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 228 00000100:00100000:0.0:1787075984.383861:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+20:11601:x1873884678813568:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787075984.383953:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075984.384005:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69400/0x859911ad686a040e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623774 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.384035:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996194304000) 00010000:00010000:0.0:1787075984.384042:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787075984.384098:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0431 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.384239:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0431 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.384252:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0431 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787075984.385446:0:5854:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 0000000025a3bd91 reply state 0000000083bc653d transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0431 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075984.385460:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787075984.385611:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+21:11601:x1873884678813568:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 1750us (2103us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1787075984.385637:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 228 00000100:00100000:3.0:1787075984.390968:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1787075984.391028:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0431 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.391045:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0431 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.391055:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0431 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.391063:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075984.391069:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0431 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.391077:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0431 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.391108:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996194304000) 00010000:00010000:0.0:1787075984.391112:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075984.391119:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0431 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.391126:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a0431 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075984.391517:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678813696 00000100:00100000:1.0:1787075984.391531:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678813696 00000100:00100000:1.0:1787075984.391614:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:1.0:1787075984.391627:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b53cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2362:x1873884678813696:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787075984.392499:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787075984.392509:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787075984 -> 1787075983 00002000:00010000:1.0:1787075984.392512:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787075983 00002000:00010000:1.0:1787075984.392515:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787075984 -> 1787075983 00002000:00010000:1.0:1787075984.392518:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787075984.393596:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b53cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2362:x1873884678813696:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 1961us (2632us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787075984.393614:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:2.0:1787075984.400488:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075984.400593:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678813952 00000100:00100000:0.0:1787075984.400608:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678813952 00000100:00100000:0.0:1787075984.400763:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 229 00000100:00100000:0.0:1787075984.400776:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+20:11601:x1873884678813952:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787075984.400967:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad686a0438 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.401004:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a03f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623766 expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.401016:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad686a0438 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.401061:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a03f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623766 expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.401075:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a03f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623766 expref: 20 pid: 5853 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075984.401095:0:5852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b91ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1873884700815104:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787075984.401466:0:5852:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eeb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075984.405741:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075984.405931:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678814080 00000100:00100000:1.0:1787075984.405946:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678814080 00010000:00010000:1.0:1787075984.406004:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a03f2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623766 expref: 21 pid: 5853 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075984.406123:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 83 00000100:00100000:1.0:1787075984.406135:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+21:2362:x1873884678814080:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787075984.406156:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075984.406165:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a03f2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623766 expref: 21 pid: 5853 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.406182:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a03f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623766 expref: 21 pid: 5853 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.406213:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996194304000) 00010000:00010000:1.0:1787075984.406219:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad686a0438 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.406232:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad686a0438 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.406242:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad686a0438 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.406558:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075984.406679:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+21:2362:x1873884678814080:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 509us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075984.406691:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 83 00010000:00010000:3.0:1787075984.408155:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a03f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623766 expref: 20 pid: 5853 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075984.408184:0:5852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b91ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1873884700815104:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787075984.408229:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad686a0438 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.408242:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad686a0438 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.408249:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad686a0438 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.408509:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad686a0438 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.408518:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad686a0438 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.408527:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad686a0438 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.408535:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075984.408541:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad686a0438 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.408581:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad686a0438 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.408606:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996194304000) 00010000:00010000:3.0:1787075984.408610:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787075984.408617:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad686a0438 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.408623:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68600/0x859911ad686a0438 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075984.408774:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+19:11601:x1873884678813952:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 Request processed in 8000us (8534us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787075984.408787:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 229 00000100:00100000:0.0:1787075984.412928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075984.413083:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678814208 00000100:00100000:2.0:1787075984.413111:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678814208 00000100:00100000:2.0:1787075984.413196:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:2.0:1787075984.413209:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2362:x1873884678814208:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787075984.413528:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004166b33a/0x859911ad686a043f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.413560:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1dd847c/0x859911ad686a041c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623782 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.413572:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787075984.413577:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787075984.413581:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004166b33a/0x859911ad686a043f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.413632:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1dd847c/0x859911ad686a041c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623782 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.413720:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1dd847c/0x859911ad686a041c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623782 expref: 8 pid: 6706 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075984.413739:0:6704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf3a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1873884700815232:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787075984.413993:0:6704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961912e2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787075984.418727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075984.418898:0:6704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf3a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1873884700815232:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787075984.418947:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004166b33a/0x859911ad686a043f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075984.419298:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678814336 00000100:00100000:3.0:1787075984.419309:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678814336 00010000:00010000:3.0:1787075984.419365:0:8465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1dd847c/0x859911ad686a041c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623782 expref: 9 pid: 6706 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075984.419419:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:3.0:1787075984.419431:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+9:2361:x1873884678814336:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787075984.419450:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787075984.419482:0:8465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1dd847c/0x859911ad686a041c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623782 expref: 9 pid: 6706 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.419498:0:8465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1dd847c/0x859911ad686a041c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623782 expref: 9 pid: 6706 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.419559:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1dd847c/0x859911ad686a041c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623782 expref: 9 pid: 6706 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.419582:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787075984.419588:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787075984.419594:0:8465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004166b33a/0x859911ad686a043f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.419607:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004166b33a/0x859911ad686a043f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075984.419684:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787075984.419767:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2361:x1873884678814336:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 336us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075984.419777:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 84 00010000:00010000:0.0:1787075984.420599:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004166b33a/0x859911ad686a043f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.420615:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004166b33a/0x859911ad686a043f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.420717:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004166b33a/0x859911ad686a043f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.420727:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004166b33a/0x859911ad686a043f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.420736:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004166b33a/0x859911ad686a043f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.420745:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840c00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787075984.420750:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004166b33a/0x859911ad686a043f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.420760:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004166b33a/0x859911ad686a043f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.420780:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004166b33a/0x859911ad686a043f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.420787:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004166b33a/0x859911ad686a043f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075984.421034:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2362:x1873884678814208:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 Request processed in 7824us (8117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075984.421046:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:2.0:1787075984.427247:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075984.427527:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678814592 00000100:00100000:1.0:1787075984.427540:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678814592 00000100:00100000:1.0:1787075984.427688:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 230 00000100:00100000:1.0:1787075984.427702:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+19:11601:x1873884678814592:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787075984.427847:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0446 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.427871:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.427884:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.428474:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a044d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.428490:0:7654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0400 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762376d expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.428500:0:7654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a044d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.428544:0:7654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0400 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762376d expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.428561:0:7654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0400 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762376d expref: 20 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075984.428579:0:7654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f54380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1873884700815360:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787075984.428734:0:7654:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961879409c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787075984.432479:0:7654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f54380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1873884700815360:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787075984.432522:0:7654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a044d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075984.433601:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075984.433944:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678814720 00000100:00100000:0.0:1787075984.433957:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678814720 00010000:00010000:0.0:1787075984.434012:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0400 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762376d expref: 21 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075984.434068:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:0.0:1787075984.434081:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+21:2361:x1873884678814720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787075984.434103:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787075984.434112:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0400 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762376d expref: 21 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.434128:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0400 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762376d expref: 21 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.434157:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0400 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762376d expref: 21 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.434180:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996194304000) 00010000:00010000:0.0:1787075984.434187:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a044d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.434197:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a044d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.434206:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a044d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.434306:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787075984.434387:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+20:2361:x1873884678814720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 308us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075984.434414:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 85 00010000:00010000:2.0:1787075984.435857:0:7654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a044d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.435878:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a044d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787075984.436835:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787075984.437377:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1787075984.437514:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1787075984.437902:0:7654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7654:1873884700815488:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787075984.438514:0:7654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075984.438903:0:7654:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961912e2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787075984.439031:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700815488 00000100:00100000:1.0:1787075984.439041:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700815488 00000100:00100000:3.0:1787075984.439842:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787075984.439858:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7654:x1873884700815488:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787075984.440044:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7654:x1873884700815488:12345-0@lo:1000:mdt00_003.0 Request processed in 190us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075984.440058:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787075984.440291:0:7654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1787075984.440300:0:7654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:2.0:1787075984.440330:0:7654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9961b52c9f80, transno 4294967321 00000004:00080000:2.0:1787075984.440396:0:7654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9961b52c8000, transno 4294967322 00000100:00100000:2.0:1787075984.441335:0:7654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7654:1873884700815488:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787075984.442939:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1787075984.443082:0:7654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7654:1873884700815616:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787075984.443196:0:7654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075984.443254:0:7654:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961912e2840 going to sleep for 11 seconds 00000100:00100000:3.0:1787075984.443469:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700815616 00000100:00100000:3.0:1787075984.443480:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700815616 00000100:00100000:3.0:1787075984.443557:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787075984.443568:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7654:x1873884700815616:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787075984.444197:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7654:x1873884700815616:12345-0@lo:1000:mdt00_003.0 Request processed in 628us (999us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787075984.444207:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787075984.446086:0:7654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9dfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7654:1873884700815616:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787075984.446562:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a044d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.446578:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a044d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.446597:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a044d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.446604:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075984.446610:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a044d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.446620:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a044d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.446673:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996194304000) 00010000:00010000:0.0:1787075984.446677:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787075984.446682:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a044d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.446689:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a044d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.446759:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0390 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.446766:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0390 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.446772:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0390 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.446787:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075984.446790:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0390 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.446797:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0390 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.446806:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:0.0:1787075984.446808:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787075984.446818:0:7654:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad686a0397 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623751 expref: 23 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.446830:0:7654:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad686a0397 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623751 expref: 23 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.446841:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad686a0397 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623751 expref: 23 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.446893:0:7654:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad686a0397 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623751 expref: 23 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075984.446912:0:7654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b91b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1873884700815744:192.168.204.50@tcp:105: 00000100:00100000:0.0:1787075984.447041:0:7654:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eeb780 going to sleep for 11 seconds 00000100:00100000:2.0:1787075984.455169:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075984.455292:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678814848 00000100:00100000:1.0:1787075984.455309:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678814848 00000100:00100000:1.0:1787075984.455460:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:1.0:1787075984.455473:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+24:11600:x1873884678814848:12345-192.168.204.50@tcp:49:lfs.0 00000100:00100000:1.0:1787075984.455722:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+24:11600:x1873884678814848:12345-192.168.204.50@tcp:49:lfs.0 Request processed in 252us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075984.455736:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:0.0:1787075984.457841:0:7654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b91b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1873884700815744:192.168.204.50@tcp:105: 00010000:00010000:0.0:1787075984.457883:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0390 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.457916:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841600/0x859911ad686a0390 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.457952:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0454 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.457968:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.457979:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.457989:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.457996:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0454 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.458002:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0454 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.458008:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075984.458013:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0454 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.458020:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0454 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.458032:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:0.0:1787075984.458035:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787075984.458038:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0454 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.458050:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69c00/0x859911ad686a0454 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.458060:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0446 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.458066:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0446 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.458201:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0446 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.458207:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787075984.458210:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0446 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.458217:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0446 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.458226:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:0.0:1787075984.458228:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787075984.458231:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0446 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.458237:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0446 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787075984.458581:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+23:11601:x1873884678814592:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 30880us (31350us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1787075984.458593:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 230 00000020:00080000:0.0:1787075984.458605:0:7654:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787075984.459314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000040:00080000:2.0:1787075984.460300:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787075984.460309:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787075984.460927:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075984.461011:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678815360 00000100:00100000:0.0:1787075984.461022:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678815360 00000100:00100000:1.0:1787075984.461207:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678815104 00000100:00100000:1.0:1787075984.461223:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678815104 00000100:00100000:1.0:1787075984.461301:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 231 00000100:00100000:1.0:1787075984.461314:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+24:11600:x1873884678815104:12345-192.168.204.50@tcp:58:lfs.0 00000100:00100000:0.0:1787075984.461472:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:0.0:1787075984.461488:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b0116450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+24:11601:x1873884678815360:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1787075984.461938:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787075984.462078:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+25:11600:x1873884678815104:12345-192.168.204.50@tcp:58:lfs.0 Request processed in 764us (2763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075984.462089:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 231 00000004:00080000:0.0:1787075984.463760:0:5856:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787075984.463906:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:0.0:1787075984.463984:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a045b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.464003:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a045b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.464014:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a045b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.464023:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a045b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.464030:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a045b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.464036:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a045b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787075984.464063:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787075984.464794:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787075984.464812:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a045b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.464826:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69a00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787075984.464831:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a045b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.464843:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a045b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.464888:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff996191b7a200) 00010000:00010000:1.0:1787075984.464892:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000040:00080000:2.0:1787075984.464895:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00010000:00010000:1.0:1787075984.464898:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a045b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787075984.464911:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787075984.464911:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe69a00/0x859911ad686a045b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.464961:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075984.464964:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075984.464969:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075984.465107:0:11694:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf655880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1873884700815872:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787075984.465220:0:11694:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961912e2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787075984.465856:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b0116450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+26:11601:x1873884678815360:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 4370us (4929us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787075984.465868:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 62 00000020:00080000:0.0:1787075984.465874:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787075984.471508:0:11694:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf655880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1873884700815872:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787075984.473885:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075984.475237:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678815488 00000100:00100000:0.0:1787075984.475282:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678815488 00000100:00100000:1.0:1787075984.477509:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 232 00000100:00100000:1.0:1787075984.477535:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+25:11602:x1873884678815488:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787075984.477742:0:5854:0:(mdt_handler.c:8026:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787075984.477882:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+25:11602:x1873884678815488:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 359us (4013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075984.477891:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 232 00000100:00100000:1.0:1787075984.484453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075984.486553:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678815744 00000100:00100000:2.0:1787075984.486585:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678815744 00000100:00100000:2.0:1787075984.486719:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 233 00000100:00100000:2.0:1787075984.486731:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+25:11602:x1873884678815744:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787075984.486755:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075984.486777:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0462 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623789 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.486896:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0469 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.486912:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.486952:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787075984.486971:0:5853:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787075984.487140:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841200/0x859911ad686a0462 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623789 expref: 28 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.487158:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0469 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623789 expref: 27 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.487166:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:2.0:1787075984.487170:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787075984.487173:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1840c00, rc 0) 00000100:00100000:2.0:1787075984.487245:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+27:11602:x1873884678815744:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 516us (2802us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787075984.487255:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 233 00000100:00100000:3.0:1787075984.493430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075984.493544:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678815872 00000100:00100000:1.0:1787075984.493564:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678815872 00000100:00100000:1.0:1787075984.493712:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 234 00000100:00100000:1.0:1787075984.493724:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+27:11604:x1873884678815872:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787075984.493768:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787075984.493802:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a0477 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623790 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.493918:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a047e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.493936:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a047e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.493950:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a047e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.493970:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0485 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.493977:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.493983:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.494359:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a048c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.494372:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762374a expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.494381:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a048c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.494419:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762374a expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.494446:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762374a expref: 28 pid: 5854 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787075984.494461:0:5854:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996188f55500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1873884700816000:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787075984.494568:0:5854:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187940cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787075984.503015:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075984.503565:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075984.503738:0:5854:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996188f55500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1873884700816000:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787075984.503780:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a048c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075984.506361:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678816384 00000100:00100000:3.0:1787075984.506380:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678816384 00000100:00100000:3.0:1787075984.506488:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:3.0:1787075984.506502:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+29:5599:x1873884678816384:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787075984.506956:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+30:5599:x1873884678816384:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 456us (3391us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787075984.506966:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:2.0:1787075984.509707:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678816256 00000100:00100000:2.0:1787075984.509729:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678816256 00000100:00100000:1.0:1787075984.510417:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 235 00000100:00100000:1.0:1787075984.510435:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+30:11602:x1873884678816256:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787075984.510563:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0493 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.510590:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0493 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.510604:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0493 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.510927:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0493 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.510935:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0493 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.510943:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0493 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.510970:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075984.510976:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0493 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.510985:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0493 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.511000:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:1.0:1787075984.511003:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787075984.511009:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0493 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.511015:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632c00/0x859911ad686a0493 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787075984.511398:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787075984.511405:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1787075984.511421:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+31:11602:x1873884678816256:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 988us (8419us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1787075984.511434:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 235 00000040:00080000:3.0:1787075984.511959:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787075984.511969:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787075984.514008:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075984.514430:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678816512 00000100:00100000:2.0:1787075984.514444:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678816512 00010000:00010000:2.0:1787075984.514501:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762374a expref: 31 pid: 5854 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787075984.514606:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 86 00000100:00100000:2.0:1787075984.514620:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a0260c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+31:2362:x1873884678816512:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075984.514692:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787075984.514703:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762374a expref: 31 pid: 5854 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.514739:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762374a expref: 31 pid: 5854 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.514770:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523000/0x859911ad686a0382 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762374a expref: 31 pid: 5854 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.514790:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:2.0:1787075984.514796:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a048c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.514818:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a048c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.514827:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a048c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075984.514860:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787075984.514936:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a0260c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+30:2362:x1873884678816512:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 319us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075984.514945:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 86 00010000:00010000:1.0:1787075984.516562:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a048c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.516584:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a048c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787075984.516681:0:5854:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787075984.516686:0:5854:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787075984.516714:0:5854:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a048c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.516732:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a048c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.516773:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a047e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.516781:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a047e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.516789:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a047e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.516807:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632e00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075984.516812:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a047e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.516820:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a047e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.516838:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:1.0:1787075984.516841:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075984.516846:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a047e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.516852:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632e00/0x859911ad686a047e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.516871:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.516877:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0485 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.516884:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0485 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.516896:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787075984.516899:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0485 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.516905:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0485 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.516913:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff996187c34400) 00010000:00010000:1.0:1787075984.516916:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075984.516919:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0485 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.516925:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633600/0x859911ad686a0485 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.516978:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632000/0x859911ad686a0477 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623790 expref: 30 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.516994:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a048c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623790 expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075984.517001:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:1.0:1787075984.517003:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787075984.517006:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf633000, rc 0) 00000100:00100000:1.0:1787075984.517085:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+29:11604:x1873884678815872:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 23362us (23671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075984.517095:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 234 00000100:00100000:3.0:1787075984.523627:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075984.523764:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678816768 00000100:00100000:2.0:1787075984.523780:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678816768 00000100:00100000:2.0:1787075984.523871:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:2.0:1787075984.523883:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+29:11602:x1873884678816768:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787075984.524405:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+30:11602:x1873884678816768:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 521us (792us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787075984.524416:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 64 00010000:00010000:0.0:1787075985.295989:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787075985.616497:0:12523:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787075985.616509:0:12523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787075985.616720:0:12523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787075985.616730:0:12523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787075985.813853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075985.814783:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678817024 00000100:00100000:3.0:1787075985.814801:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678817024 00000100:00100000:3.0:1787075985.815242:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 236 00000100:00100000:3.0:1787075985.815256:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+30:11627:x1873884678817024:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787075985.815295:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075985.815322:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a049a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623797 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075985.815453:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a04a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075985.815471:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a04a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075985.815494:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a04a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787075985.815509:0:7654:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787075985.815713:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a049a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623797 expref: 33 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075985.815736:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a04a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623797 expref: 32 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075985.815746:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:3.0:1787075985.815750:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787075985.815754:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523400, rc 0) 00000100:00100000:3.0:1787075985.815833:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+32:11627:x1873884678817024:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 580us (1996us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787075985.815841:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 236 00000100:00100000:1.0:1787075985.820131:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075985.820224:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678817152 00000100:00100000:3.0:1787075985.820238:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678817152 00000100:00100000:3.0:1787075985.820325:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 237 00000100:00100000:3.0:1787075985.820341:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+32:11627:x1873884678817152:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:3.0:1787075985.820440:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a04af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075985.820463:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a04af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075985.820478:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a04af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075985.820525:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a04af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075985.820533:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a04af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075985.820554:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a04af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075985.820562:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787075985.820567:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a04af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075985.820575:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a04af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075985.820591:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:3.0:1787075985.820595:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787075985.820600:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a04af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075985.820607:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a04af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787075985.820841:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+32:11627:x1873884678817152:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 504us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075985.820852:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 237 00000100:00100000:1.0:1787075985.912612:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075985.913334:0:12484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678817280 00000100:00100000:2.0:1787075985.913354:0:12484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678817280 00000100:00100000:2.0:1787075985.913535:0:12484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 71 00000100:00100000:2.0:1787075985.913551:0:12484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2359:x1873884678817280:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1787075985.913580:0:12484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787075985.913612:0:12484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060b3fc4f/0x859911ad686a04b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762379e expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787075985.913684:0:12484:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a849d8f, atime: 0x6a849d8f, ctime: 0x6a849d8f, blocks: 0xb 00010000:00010000:2.0:1787075985.913713:0:12484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=367s v=(0 0) 00010000:00010000:2.0:1787075985.913833:0:12484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787075985.913847:0:12484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060b3fc4f/0x859911ad686a04b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762379e expref: 8 pid: 12484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075985.913870:0:12484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060b3fc4f/0x859911ad686a04b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762379e expref: 8 pid: 12484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075985.913891:0:12484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1840a00, rc 0) 00000100:00100000:2.0:1787075985.914044:0:12484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2359:x1873884678817280:12345-192.168.204.50@tcp:101:cat.0 Request processed in 497us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075985.914052:0:12484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 71 00000100:00100000:3.0:1787075985.920188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075985.920595:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678817408 00000100:00100000:1.0:1787075985.920612:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678817408 00002000:00100000:1.0:1787075985.920770:0:6711:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9961b00fd180 x1873884678817408/t0(0) o3->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1787075996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787075985.920784:0:6711:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961b00fd180 with x1873884678817408 ext(0->4095) 00002000:00010000:1.0:1787075985.920791:0:6711:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9961b00fd180 00000100:00100000:1.0:1787075985.920829:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:1.0:1787075985.920842:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2360:x1873884678817408:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1787075985.923694:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2360:x1873884678817408:12345-192.168.204.50@tcp:3:cat.0 Request processed in 2836us (3504us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787075985.923712:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00002000:00100000:1.0:1787075985.923726:0:6711:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9961b00fd180 x1873884678817408/t0(0) o3->a850c61f-0242-4b36-8952-7b46dff1f2b9@192.168.204.50@tcp:56/0 lens 488/4536 e 0 to 0 dl 1787075996 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787075985.923738:0:6711:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9961b00fd180 with x1873884678817408 ext(0->4095) 00002000:00010000:1.0:1787075985.923745:0:6711:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9961b00fd180 00000001:00080000:0.0:1787075986.231561:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1787075986.231593:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:1.0:1787075986.314178:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075987.144604:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700816384:0@lo:400:kworker.0 00000100:00100000:1.0:1787075987.144692:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075987.144845:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700816128:0@lo:400:kworker.0 00000100:00100000:2.0:1787075987.144881:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075987.144901:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700816640:0@lo:400:kworker.0 00000100:00100000:2.0:1787075987.144921:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075987.144952:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787075987.144957:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700816256:0@lo:400:kworker.0 00000100:00100000:2.0:1787075987.144976:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075987.144988:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf51c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700816768:0@lo:400:kworker.0 00000100:00100000:2.0:1787075987.145005:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075987.145027:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf51df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700816512:0@lo:400:kworker.0 00000100:00100000:2.0:1787075987.145046:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075987.145095:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700816128 00000100:00100000:2.0:1787075987.145102:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700816128 00000100:00100000:2.0:1787075987.145147:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787075987.145155:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700816128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075987.145204:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3313:x1873884700816128:12345-0@lo:400:kworker.0 Request processed in 49us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075987.145212:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787075987.145242:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700816384 00000100:00100000:2.0:1787075987.145245:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700816384 00000100:00100000:2.0:1787075987.145280:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700816640 00000100:00100000:2.0:1787075987.145284:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700816640 00000100:00100000:2.0:1787075987.145295:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700816256 00000100:00100000:2.0:1787075987.145297:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700816256 00000100:00100000:2.0:1787075987.145308:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787075987.145314:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700816384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075987.145345:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700816384:12345-0@lo:400:kworker.0 Request processed in 31us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075987.145351:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787075987.145362:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787075987.146559:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700816640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075987.146658:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700816640:12345-0@lo:400:kworker.0 Request processed in 1290us (1736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075987.146666:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787075987.146687:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787075987.146695:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700816256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075987.146725:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700816256:12345-0@lo:400:kworker.0 Request processed in 31us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075987.146730:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787075987.146829:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700816896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075987.146867:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075987.146914:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700816384:0@lo:400:kworker.0 00000100:00100000:2.0:1787075987.147538:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700816768 00000100:00100000:2.0:1787075987.147547:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700816768 00000100:00100000:2.0:1787075987.147591:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700816512 00000100:00100000:2.0:1787075987.147610:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700816512 00000100:00100000:2.0:1787075987.147658:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787075987.147667:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1873884700816768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075987.147712:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1873884700816768:12345-0@lo:400:kworker.0 Request processed in 47us (2705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075987.147718:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787075987.147729:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787075987.147734:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700816512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075987.147761:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700816512:12345-0@lo:400:kworker.0 Request processed in 27us (2713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075987.147767:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1787075987.147791:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787075987.147795:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787075987.147798:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787075987.147813:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700816896 00000100:00100000:2.0:1787075987.147817:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700816896 00000100:00100000:2.0:1787075987.147846:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787075987.147852:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1873884700816896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787075987.147879:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075987.148233:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1873884700816896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 379us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075987.148240:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787075987.148349:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787075987.148356:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9961b52c9880, transno 4294967307 00000004:00080000:2.0:1787075987.148370:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1787075987.148389:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9961b91bad80, transno 4294967310 00000100:00100000:2.0:1787075987.148397:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf51df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700816512:0@lo:400:kworker.0 00000100:00100000:2.0:1787075987.148717:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700816256:0@lo:400:kworker.0 00000100:00100000:2.0:1787075987.148730:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf51c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700816768:0@lo:400:kworker.0 00000100:00100000:2.0:1787075987.148741:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700816128:0@lo:400:kworker.0 00000100:00100000:2.0:1787075987.148751:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700816640:0@lo:400:kworker.0 00000100:00100000:3.0:1787075987.150254:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700816896:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787075987.341472:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787075987.746788:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075987.746832:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075987.746975:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678817536 00000100:00100000:3.0:1787075987.746986:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678817536 00000100:00100000:3.0:1787075987.747058:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 294 00000100:00100000:3.0:1787075987.747068:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2362:x1873884678817536:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075987.747141:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2362:x1873884678817536:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 75us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075987.747149:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 294 00000100:00100000:1.0:1787075987.748053:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075987.748073:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075987.748095:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075987.748145:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678818048 00000100:00100000:3.0:1787075987.748152:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678818048 00000100:00100000:3.0:1787075987.748198:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 156 00000100:00100000:3.0:1787075987.748206:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2362:x1873884678818048:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075987.748249:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:2362:x1873884678818048:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 44us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075987.748257:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 156 00000100:00100000:3.0:1787075987.748268:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678817664 00000100:00100000:3.0:1787075987.748271:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678817664 00000100:00100000:3.0:1787075987.748291:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 157 00000100:00100000:3.0:1787075987.748296:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+32:2362:x1873884678817664:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075987.748318:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+32:2362:x1873884678817664:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 21us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075987.748324:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 157 00000100:00080000:3.0:1787075987.748418:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787075987.751475:0:12484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678817792 00000100:00100000:2.0:1787075987.751489:0:12484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678817792 00000100:00100000:2.0:1787075987.751598:0:12484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678817920 00000100:00100000:2.0:1787075987.751602:0:12484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678817920 00000100:00100000:2.0:1787075987.751634:0:12484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00080000:0.0:1787075987.751661:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787075987.751664:0:12484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678817792:12345-192.168.204.50@tcp:400:kworker.0 00000100:00080000:0.0:1787075987.751668:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787075987.751670:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:1.0:1787075987.751684:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2362:x1873884678817920:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075987.751775:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+8:2362:x1873884678817920:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 94us (3677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075987.751784:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:2.0:1787075987.751797:0:12484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2362:x1873884678817792:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 136us (4963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075987.751804:0:12484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00100000:3.0:1787075988.169906:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700817024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787075988.169976:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075988.170293:0:9220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700817024 00000100:00100000:0.0:1787075988.170302:0:9220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700817024 00000100:00100000:0.0:1787075988.170351:0:9220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787075988.170359:0:9220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700817024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787075988.170392:0:9220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787075988.174380:0:9220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700817024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4013us (4394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075988.174397:0:9220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787075988.178151:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700817024:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787075988.360095:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787075988.615847:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787075988.615857:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787075988.615888:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787075988.615895:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787075989.386129:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787075989.766898:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1787075989.769903:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1787075989.780672:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000020:00080000:0.0:1787075989.780915:0:5874:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1787075989.780958:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:2.0:1787075989.780978:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1787075989.781015:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:0.0:1787075989.781029:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1787075989.781041:0:5874:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9961912e2a80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787075989.781048:0:5874:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9961a5378400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9961912e2540 00000020:00080000:0.0:1787075989.781069:0:5874:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9961a5378800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9961bedb6400 00000020:00080000:2.0:1787075989.781107:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787075989.781415:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1787075989.781800:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:2.0:1787075990.408905:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787075990.777999:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075990.779240:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678818176 00000100:00100000:1.0:1787075990.779252:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678818176 00000100:00100000:1.0:1787075990.779337:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 238 00000100:00100000:1.0:1787075990.779348:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+19:11288:x1873884678818176:12345-192.168.204.50@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787075990.779468:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+19:11288:x1873884678818176:12345-192.168.204.50@tcp:60:lhsmtool_posix.0 Request processed in 122us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075990.779476:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 238 00000100:00080000:0.0:1787075990.779581:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787075990.783966:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787075990.784273:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678818432 00000100:00100000:1.0:1787075990.784288:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678818432 00000100:00100000:1.0:1787075990.784371:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:1.0:1787075990.784384:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+19:11288:x1873884678818432:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787075990.786086:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+20:11288:x1873884678818432:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 1693us (2126us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787075990.786101:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:2.0:1787075991.075872:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075991.075983:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678818560 00000100:00100000:3.0:1787075991.075996:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678818560 00000100:00100000:3.0:1787075991.076249:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 239 00000100:00100000:3.0:1787075991.076264:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b46436a-eac8-40ba-903d-0628e5cbe0d3+5:12078:x1873884678818560:12345-192.168.204.50@tcp:101:lsof.0 00010000:00010000:3.0:1787075991.076293:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787075991.076465:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a04bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76237a5 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075991.076564:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a04c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075991.076582:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a04c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075991.076597:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a04c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787075991.076761:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1787075991.077528:0:5852:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787075991.077537:0:5852:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787075991.077688:0:5852:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a04c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075991.077733:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523a00/0x859911ad686a04bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76237a5 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075991.077766:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a04c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76237a5 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787075991.077776:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ae00) 00010000:00010000:3.0:1787075991.077779:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787075991.077783:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523600, rc 0) 00000100:00100000:3.0:1787075991.077886:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:12078:x1873884678818560:12345-192.168.204.50@tcp:101:lsof.0 Request processed in 1625us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075991.077895:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 239 00010000:00010000:0.0:1787075991.432461:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075992.263975:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787075992.264132:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700817152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787075992.264240:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075992.264853:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700817152 00000100:00100000:1.0:1787075992.264867:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700817152 00000100:00080000:3.0:1787075992.264943:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787075992.264949:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787075992.264962:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700817152:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787075992.265391:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700817408:0@lo:400:kworker.0 00000100:00100000:2.0:1787075992.265452:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075992.265490:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700817536:0@lo:400:kworker.0 00000100:00100000:2.0:1787075992.265507:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bf778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700817664:0@lo:400:kworker.0 00000100:00100000:3.0:1787075992.265535:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075992.265535:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075992.265621:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700817280:0@lo:400:kworker.0 00002000:00000024:1.0:1787075992.265716:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075992.269627:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700817664 00000100:00100000:2.0:1787075992.269662:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700817664 00000100:00100000:2.0:1787075992.270258:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787075992.270276:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700817664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075992.272608:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700817408 00000100:00100000:3.0:1787075992.272628:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700817408 00000100:00100000:3.0:1787075992.273252:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700817536 00000100:00100000:3.0:1787075992.273259:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700817536 00000100:00100000:3.0:1787075992.273296:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787075992.273307:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700817408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075992.273438:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700817408:12345-0@lo:400:kworker.0 Request processed in 132us (7984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075992.273447:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787075992.273468:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787075992.273475:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700817536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787075992.273524:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700817536:12345-0@lo:400:kworker.0 Request processed in 50us (7988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075992.273551:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:3.0:1787075992.273577:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787075992.273583:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787075992.278290:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700817408:0@lo:400:kworker.0 00000100:00100000:1.0:1787075992.278947:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700817152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8724us (9442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075992.278964:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787075992.279116:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700817664:0@lo:400:kworker.0 00000100:00100000:0.0:1787075992.280236:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075992.280303:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873884700817792:0@lo:400:kworker.0 00000100:00100000:0.0:1787075992.280349:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075992.280392:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1787075992.280400:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1787075992.280438:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700817152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075992.280886:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700817280 00000100:00100000:1.0:1787075992.280895:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700817280 00000100:00100000:1.0:1787075992.280960:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787075992.280970:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700817280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075992.281062:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700817280:12345-0@lo:400:kworker.0 Request processed in 93us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075992.281071:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787075992.281124:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700817792 00000100:00100000:1.0:1787075992.281129:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700817792 00000100:00100000:1.0:1787075992.281176:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787075992.281182:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873884700817792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075992.281219:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1873884700817792:12345-0@lo:400:kworker.0 Request processed in 37us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075992.281227:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1787075992.281258:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787075992.281457:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9de6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700817280:0@lo:400:kworker.0 00000100:00100000:0.0:1787075992.281471:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1873884700817792:0@lo:400:kworker.0 00000100:00100000:2.0:1787075992.281636:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700817664:12345-0@lo:400:kworker.0 Request processed in 7801us (12533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075992.281779:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787075992.283410:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bf779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700817536:0@lo:400:kworker.0 00010000:00010000:2.0:1787075992.458309:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075992.861385:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075992.861513:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075992.861625:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075992.861700:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075992.861744:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075992.861817:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678818688 00000100:00100000:0.0:1787075992.861828:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678818688 00000100:00100000:3.0:1787075992.862011:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678819072 00000100:00100000:3.0:1787075992.862015:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678819072 00000100:00100000:3.0:1787075992.862057:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678818944 00000100:00100000:3.0:1787075992.862060:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678818944 00000100:00100000:3.0:1787075992.862084:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:3.0:1787075992.862094:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2360:x1873884678819072:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075992.862183:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2360:x1873884678819072:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 90us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075992.862191:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:3.0:1787075992.862207:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:3.0:1787075992.862213:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2360:x1873884678818944:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075992.862236:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2360:x1873884678818944:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 24us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075992.862242:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00080000:3.0:1787075992.862401:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787075992.862406:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787075992.862937:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 296 00000100:00100000:0.0:1787075992.862952:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2360:x1873884678818688:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787075992.863001:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191060450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2360:x1873884678818688:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 55us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075992.863026:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 296 00000100:00100000:1.0:1787075992.866948:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678818816 00000100:00100000:1.0:1787075992.866965:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678818816 00000100:00100000:1.0:1787075992.867045:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678819200 00000100:00100000:1.0:1787075992.867049:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678819200 00000100:00100000:1.0:1787075992.867073:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 161 00000100:00100000:1.0:1787075992.867083:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996188f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+20:2360:x1873884678818816:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075992.867213:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996188f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+20:2360:x1873884678818816:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 130us (5838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075992.867222:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 161 00000100:00100000:1.0:1787075992.867239:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 162 00000100:00100000:1.0:1787075992.867246:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:2360:x1873884678819200:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787075992.867270:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:2360:x1873884678819200:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 25us (5526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075992.867277:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 162 00000100:00080000:0.0:1787075992.869495:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075993.288431:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700817920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787075993.288546:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075993.290246:0:9220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700817920 00000100:00100000:0.0:1787075993.290262:0:9220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700817920 00000100:00100000:0.0:1787075993.290356:0:9220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787075993.290368:0:9220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700817920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787075993.290417:0:9220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787075993.293243:0:9220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700817920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2862us (4681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075993.293265:0:9220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787075993.293572:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700817920:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787075993.480069:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075994.506491:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787075994.576947:0:12726:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 13:59:53 (1787075993) 00000001:00080000:2.0:1787075994.868526:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1787075994.868994:0:5874:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1787075994.869020:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1787075994.869030:0:5885:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1787075995.528155:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075996.558365:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787075997.384089:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700818048:0@lo:400:kworker.0 00000100:00100000:3.0:1787075997.384246:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075997.384310:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700818560:0@lo:400:kworker.0 00000100:00100000:3.0:1787075997.384408:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787075997.384437:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787075997.384444:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700818432:0@lo:400:kworker.0 00000100:00100000:3.0:1787075997.384470:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075997.384824:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700818176:0@lo:400:kworker.0 00000100:00100000:1.0:1787075997.384857:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075997.384887:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700818688:0@lo:400:kworker.0 00000100:00100000:1.0:1787075997.384908:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075997.384925:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787075997.384930:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996191943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700818304:0@lo:400:kworker.0 00000100:00100000:1.0:1787075997.384949:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787075997.384978:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700818560 00000100:00100000:1.0:1787075997.384986:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700818560 00000100:00100000:1.0:1787075997.385039:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700818176 00000100:00100000:1.0:1787075997.385042:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700818176 00000100:00100000:1.0:1787075997.385056:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700818304 00000100:00100000:1.0:1787075997.385058:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700818304 00000100:00100000:1.0:1787075997.385071:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787075997.385081:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700818560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075997.385135:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700818560:12345-0@lo:400:kworker.0 Request processed in 55us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075997.385157:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787075997.385251:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787075997.385259:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700818176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075997.385294:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700818176:12345-0@lo:400:kworker.0 Request processed in 36us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075997.385300:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787075997.385313:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787075997.385319:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700818304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787075997.385356:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700818304:12345-0@lo:400:kworker.0 Request processed in 36us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075997.385361:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:0.0:1787075997.385376:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787075997.385407:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700818304:0@lo:400:kworker.0 00000100:00100000:1.0:1787075997.385419:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700818176:0@lo:400:kworker.0 00000100:00100000:2.0:1787075997.385501:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700818048 00000100:00100000:2.0:1787075997.385512:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700818048 00000100:00100000:2.0:1787075997.385697:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1787075997.385706:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191063850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3312:x1873884700818048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075997.385926:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191063850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3312:x1873884700818048:12345-0@lo:400:kworker.0 Request processed in 222us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075997.385932:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1787075997.385965:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700818432 00000100:00100000:2.0:1787075997.385970:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700818432 00000100:00100000:2.0:1787075997.385999:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700818688 00000100:00100000:2.0:1787075997.386002:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700818688 00000100:00100000:2.0:1787075997.386019:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787075997.386026:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9de5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700818432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075997.386056:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9de5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700818432:12345-0@lo:400:kworker.0 Request processed in 30us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075997.386062:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787075997.386072:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787075997.386078:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700818688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787075997.386108:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700818688:12345-0@lo:400:kworker.0 Request processed in 30us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075997.386115:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1787075997.386140:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787075997.386143:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787075997.387025:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700818688:0@lo:400:kworker.0 00000100:00100000:3.0:1787075997.387219:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700818432:0@lo:400:kworker.0 00000100:00100000:3.0:1787075997.387231:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996191941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700818048:0@lo:400:kworker.0 00000100:00100000:3.0:1787075997.387241:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700818560:0@lo:400:kworker.0 00000100:00100000:1.0:1787075997.387299:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787075997.387310:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a53de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700818816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787075997.387361:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787075997.387448:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700818816 00000100:00100000:2.0:1787075997.387455:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700818816 00000100:00100000:2.0:1787075997.387497:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787075997.387506:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700818816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787075997.387545:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787075997.387612:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700818816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075997.387620:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787075997.387779:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a53de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700818816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787075997.576059:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787075997.984122:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075997.984235:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075997.984271:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075997.984287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075997.984312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075997.984338:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678819840 00000100:00100000:3.0:1787075997.984348:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678819840 00000100:00100000:3.0:1787075997.984417:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678819456 00000100:00100000:3.0:1787075997.984420:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678819456 00000100:00100000:3.0:1787075997.984443:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 166 00000100:00100000:3.0:1787075997.984453:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:2361:x1873884678819840:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075997.984529:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:2361:x1873884678819840:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 77us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075997.984537:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 166 00000100:00100000:3.0:1787075997.984570:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 167 00000100:00100000:3.0:1787075997.984578:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+19:2361:x1873884678819456:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075997.984608:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+19:2361:x1873884678819456:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 31us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075997.984614:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 167 00000100:00080000:3.0:1787075997.984684:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787075997.984696:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678819584 00000100:00100000:3.0:1787075997.984699:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678819584 00000100:00100000:0.0:1787075997.985844:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678819712 00000100:00100000:0.0:1787075997.985853:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678819712 00000100:00100000:0.0:1787075997.985920:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 88 00000100:00100000:0.0:1787075997.985929:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2361:x1873884678819712:12345-192.168.204.50@tcp:400:kworker.0 00000100:00080000:1.0:1787075997.985938:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787075997.985989:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2361:x1873884678819712:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 61us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075997.985998:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 88 00000100:00100000:3.0:1787075997.989285:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:3.0:1787075997.989301:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2361:x1873884678819584:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787075997.989404:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2361:x1873884678819584:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 107us (5168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075997.989412:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00080000:1.0:1787075997.989439:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787075997.991318:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678819328 00000100:00100000:2.0:1787075997.991331:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678819328 00000100:00100000:2.0:1787075997.991443:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 298 00000100:00100000:2.0:1787075997.991451:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2361:x1873884678819328:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787075997.991521:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191062050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2361:x1873884678819328:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 70us (7410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075997.991535:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 298 00000100:00100000:1.0:1787075998.372948:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075998.373063:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678820096 00000100:00100000:0.0:1787075998.373073:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678820096 00000100:00100000:0.0:1787075998.373135:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00100000:0.0:1787075998.373144:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+19:12299:x1873884678820096:12345-192.168.204.50@tcp:35:umount.0 00000100:00100000:0.0:1787075998.373816:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+20:12299:x1873884678820096:12345-192.168.204.50@tcp:35:umount.0 Request processed in 668us (891us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1787075998.373826:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00100000:3.0:1787075998.379275:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075998.379372:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678820352 00000100:00100000:0.0:1787075998.379392:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678820352 00000100:00100000:0.0:1787075998.380206:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:0.0:1787075998.380223:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+20:12299:x1873884678820352:12345-192.168.204.50@tcp:35:umount.0 00000100:00100000:0.0:1787075998.381987:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+21:12299:x1873884678820352:12345-192.168.204.50@tcp:35:umount.0 Request processed in 1337us (2289us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787075998.382001:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:3.0:1787075998.393992:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075998.395281:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678820608 00000100:00100000:2.0:1787075998.395297:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678820608 00000100:00100000:2.0:1787075998.395371:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:2.0:1787075998.395392:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b0116c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+21:12299:x1873884678820608:12345-192.168.204.50@tcp:35:umount.0 00000100:00100000:2.0:1787075998.396002:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b0116c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+22:12299:x1873884678820608:12345-192.168.204.50@tcp:35:umount.0 Request processed in 610us (2027us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787075998.396012:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:1.0:1787075998.401635:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075998.401817:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678820864 00000100:00100000:0.0:1787075998.401827:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678820864 00000100:00100000:0.0:1787075998.401876:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:0.0:1787075998.401885:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+22:12299:x1873884678820864:12345-192.168.204.50@tcp:35:umount.0 00000100:00100000:0.0:1787075998.402454:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a850c61f-0242-4b36-8952-7b46dff1f2b9+23:12299:x1873884678820864:12345-192.168.204.50@tcp:35:umount.0 Request processed in 567us (827us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1787075998.402463:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:3.0:1787075998.408193:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700818944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787075998.408271:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787075998.408418:0:9220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700818944 00000100:00100000:0.0:1787075998.408427:0:9220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700818944 00000100:00100000:0.0:1787075998.408488:0:9220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787075998.408497:0:9220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700818944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787075998.408544:0:9220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787075998.408595:0:9220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700818944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075998.408602:0:9220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787075998.409119:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700818944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787075998.411805:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075998.411848:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075998.411999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787075998.412834:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678821120 00000100:00100000:2.0:1787075998.412846:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678821120 00000100:00100000:2.0:1787075998.412914:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678821376 00000100:00100000:2.0:1787075998.412918:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678821376 00000100:00100000:2.0:1787075998.412933:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678821248 00000100:00100000:2.0:1787075998.412935:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678821248 00000100:00100000:2.0:1787075998.412954:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:1.0:1787075998.412967:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:1.0:1787075998.412981:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fbce478-41bc-496b-b8c6-033a0ad89c67+15:2360:x1873884678821376:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787075998.413014:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787075998.413026:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fbce478-41bc-496b-b8c6-033a0ad89c67+15:2360:x1873884678821120:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787075998.413037:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961bf633e00/0x859911ad6869f750 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233fb expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075998.413049:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787075998.413057:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787075998.413064:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996190039000/0x859911ad6869f4da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623330 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787075998.413100:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787075998.413124:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2360:x1873884678821376:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 145us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075998.413127:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fbce478-41bc-496b-b8c6-033a0ad89c67+13:2360:x1873884678821120:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 164us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787075998.413138:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:3.0:1787075998.414187:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075998.414217:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678821632 00000100:00100000:3.0:1787075998.414224:0:8477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678821632 00000100:00100000:3.0:1787075998.414266:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00100000:3.0:1787075998.414274:0:8477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+7:2358:x1873884678821632:12345-192.168.204.50@tcp:9:umount.0 00000020:00000080:3.0:1787075998.414311:0:8477:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869fa75 00000020:00010000:3.0:1787075998.414318:0:8477:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9961a6f22000: total 0 00000100:00080000:3.0:1787075998.414322:0:8477:0:(import.c:65:import_set_state_nolock()) ffff9961a6f21000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787075998.414359:0:8477:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787075998.414666:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:2.0:1787075998.414689:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:2.0:1787075998.414697:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fbce478-41bc-496b-b8c6-033a0ad89c67+11:2360:x1873884678821248:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787075998.414709:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00010000:1.0:1787075998.414996:0:5840:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9961a6f22000: total 0 00010000:00010000:1.0:1787075998.415032:0:5840:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9961a6f22000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787075998.415082:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad6869fe18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235d0 expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075998.415132:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060b3fc4f/0x859911ad686a04b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762379e expref: 6 pid: 12484 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075998.415148:0:5840:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9961a6f22000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787075998.415201:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181523200/0x859911ad6869f4a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76232f8 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075998.415211:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075998.415214:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787075998.415215:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075998.415219:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787075998.415419:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2360:x1873884678821248:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 722us (3418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787075998.415429:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:3.0:1787075998.415473:0:8477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+2:2358:x1873884678821632:12345-192.168.204.50@tcp:9:umount.0 Request processed in 1198us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787075998.415481:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00100000:3.0:1787075998.429876:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787075998.430316:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678821760 00000100:00100000:0.0:1787075998.430327:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678821760 00000100:00100000:0.0:1787075998.430398:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:0.0:1787075998.430408:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+5:2358:x1873884678821760:12345-192.168.204.50@tcp:9:umount.0 00000020:00000080:0.0:1787075998.430439:0:6704:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f814 00000100:00080000:0.0:1787075998.430449:0:6704:0:(import.c:65:import_set_state_nolock()) ffff9961a6e02000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787075998.430503:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1787075998.430566:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787075998.430821:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a850c61f-0242-4b36-8952-7b46dff1f2b9+2:2358:x1873884678821760:12345-192.168.204.50@tcp:9:umount.0 Request processed in 413us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787075998.430829:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:0.0:1787075998.439550:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787075998.439831:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678822784 00000100:00100000:3.0:1787075998.439843:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678822784 00000100:00100000:3.0:1787075998.441492:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 240 00000100:00100000:3.0:1787075998.441516:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+23:2358:x1873884678822784:12345-192.168.204.50@tcp:39:umount.0 00000020:00000080:3.0:1787075998.441555:0:7654:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f4b0 00000020:00010000:3.0:1787075998.441585:0:7654:0:(genops.c:1942:obd_stale_export_put()) Put export ffff996191816800: total 0 00000100:00080000:3.0:1787075998.441590:0:7654:0:(import.c:65:import_set_state_nolock()) ffff9961bfdca000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787075998.441622:0:7654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1787075998.442240:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a850c61f-0242-4b36-8952-7b46dff1f2b9+22:2358:x1873884678822784:12345-192.168.204.50@tcp:39:umount.0 Request processed in 732us (2697us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787075998.442250:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 240 00000020:00010000:1.0:1787075998.442319:0:5840:0:(genops.c:1928:obd_stale_export_get()) Get export ffff996191816800: total 0 00010000:00010000:1.0:1787075998.442323:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075998.442363:0:5840:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff996191816800, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1787075998.442406:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:1.0:1787075998.442410:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787075998.442418:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032e00/0x859911ad6869f7ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623425 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075998.442462:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff996191b79c00) 00010000:00010000:1.0:1787075998.442464:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787075998.442469:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032000/0x859911ad6869fad7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76234f7 expref: 20 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075998.442488:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff996194304300) 00010000:00010000:1.0:1787075998.442491:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787075998.442495:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522000/0x859911ad6869f77a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623409 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075998.442524:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:1.0:1787075998.442527:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787075998.442530:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032400/0x859911ad6869fe96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235f3 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075998.442542:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99619211ca00) 00010000:00010000:1.0:1787075998.442544:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787075998.442547:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633400/0x859911ad686a0175 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76236c5 expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075998.442574:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:1.0:1787075998.442577:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787075998.442581:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632a00/0x859911ad686a0397 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623751 expref: 16 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075998.442593:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:1.0:1787075998.442595:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787075998.442606:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633000/0x859911ad686a048c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623790 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075998.442621:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:1.0:1787075998.442623:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787075998.442627:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9032600/0x859911ad6869fcf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623583 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075998.442672:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996191b79600) 00010000:00010000:1.0:1787075998.442675:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787075998.442679:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961b9033200/0x859911ad6869f796 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623410 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075998.442696:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:1.0:1787075998.442699:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787075998.442702:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0469 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623789 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075998.442714:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ae00) 00010000:00010000:1.0:1787075998.442716:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787075998.442720:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bfe68400/0x859911ad6869fe7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235ec expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075998.442732:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99619211ce00) 00010000:00010000:1.0:1787075998.442735:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787075998.442739:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523400/0x859911ad686a04a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623797 expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075998.442753:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:1.0:1787075998.442761:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787075998.442766:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf633c00/0x859911ad6869fdd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235bb expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075998.442779:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff996187c34200) 00010000:00010000:1.0:1787075998.442781:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787075998.442784:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961bf632800/0x859911ad6869fe03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76235c9 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787075998.442796:0:5840:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff996191816800, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1787075998.442809:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075998.442811:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787075998.442813:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787075998.609181:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787075998.856161:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787075998.856171:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787075998.856692:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1787075998.856699:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787075999.624677:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787076000.012106:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:3.0:1787076000.012138:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a850c61f-0242-4b36-8952-7b46dff1f2b9 00000001:00080000:3.0:1787076000.012144:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1787076000.012148:0:5874:0:(genops.c:906:class_export_put()) final put ffff996191816800/a850c61f-0242-4b36-8952-7b46dff1f2b9 00000020:00000080:0.0:1787076000.012421:0:12638:0:(genops.c:865:class_export_destroy()) destroying export ffff996191816800/a850c61f-0242-4b36-8952-7b46dff1f2b9 for lustre-MDT0000 00000020:00000080:0.0:1787076000.012498:0:12638:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961bfdca000 for lustre-MDT0000 00000001:00100000:1.0:1787076000.017231:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a850c61f-0242-4b36-8952-7b46dff1f2b9 00000020:00000080:1.0:1787076000.017242:0:7657:0:(genops.c:906:class_export_put()) final put ffff9961a6f22000/a850c61f-0242-4b36-8952-7b46dff1f2b9 00000020:00000080:3.0:1787076000.017316:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9961a6f22000/a850c61f-0242-4b36-8952-7b46dff1f2b9 for lustre-OST0001 00000020:00000080:3.0:1787076000.017380:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961a6f21000 for lustre-OST0001 00000100:00100000:3.0:1787076000.435378:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076000.435430:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076000.435668:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678822912 00000100:00100000:1.0:1787076000.435679:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678822912 00000100:00100000:1.0:1787076000.435742:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678823168 00000100:00100000:1.0:1787076000.435746:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678823168 00000100:00100000:1.0:1787076000.435770:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:1.0:1787076000.435780:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fbce478-41bc-496b-b8c6-033a0ad89c67+11:2362:x1873884678822912:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787076000.435796:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787076000.435817:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996183be7800/0x859911ad6869f582 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623345 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076000.435836:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:2.0:1787076000.435850:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fbce478-41bc-496b-b8c6-033a0ad89c67+10:2362:x1873884678823168:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787076000.435851:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787076000.435862:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787076000.435874:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961b9033c00/0x859911ad6869f749 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76233f4 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076000.435886:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787076000.435907:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:2362:x1873884678822912:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 126us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076000.435915:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1845f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fbce478-41bc-496b-b8c6-033a0ad89c67+9:2362:x1873884678823168:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 67us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076000.435917:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:2.0:1787076000.435939:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:3.0:1787076000.436474:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076000.436609:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678823040 00000100:00100000:1.0:1787076000.436615:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678823040 00000100:00100000:1.0:1787076000.436692:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:1.0:1787076000.436703:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1847800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fbce478-41bc-496b-b8c6-033a0ad89c67+8:2362:x1873884678823040:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787076000.436712:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787076000.436723:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996183be7600/0x859911ad6869f589 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762336f expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076000.436737:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787076000.436775:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1847800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fbce478-41bc-496b-b8c6-033a0ad89c67+7:2362:x1873884678823040:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 74us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076000.436783:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:1.0:1787076000.441762:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076000.441986:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678823424 00000100:00100000:3.0:1787076000.441997:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678823424 00000100:00080000:1.0:1787076000.442059:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787076000.442080:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 241 00000100:00100000:3.0:1787076000.442091:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+6:2358:x1873884678823424:12345-192.168.204.50@tcp:39:umount.0 00000020:00000080:3.0:1787076000.442137:0:5854:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f597 00000020:00010000:3.0:1787076000.442146:0:5854:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9961b00b6000: total 0 00000100:00080000:3.0:1787076000.442150:0:5854:0:(import.c:65:import_set_state_nolock()) ffff9961b00b0000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1787076000.442330:0:5839:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9961b00b6000: total 0 00010000:00010000:2.0:1787076000.442392:0:5839:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9961b00b6000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787076000.442429:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b7ae00) 00000001:00000004:3.0:1787076000.442432:0:5854:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:2.0:1787076000.442433:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787076000.442442:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523600/0x859911ad686a04c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76237a5 expref: 5 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076000.442464:0:5839:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9961b00b6000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787076000.442475:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076000.442477:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076000.442479:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787076000.443025:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b46436a-eac8-40ba-903d-0628e5cbe0d3+3:2358:x1873884678823424:12345-192.168.204.50@tcp:39:umount.0 Request processed in 933us (1270us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1787076000.443036:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 241 00000100:00100000:2.0:1787076000.479768:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076000.479836:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678823680 00000100:00100000:1.0:1787076000.479848:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678823680 00000100:00100000:1.0:1787076000.479908:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 299 00000100:00100000:1.0:1787076000.479929:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+7:2358:x1873884678823680:12345-192.168.204.50@tcp:251:umount.0 00000020:00000080:1.0:1787076000.479976:0:5844:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f48d 00000020:00010000:1.0:1787076000.479985:0:5844:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9961bfdc9000: total 0 00000100:00080000:1.0:1787076000.479990:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9961bfdca800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787076000.480082:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fbce478-41bc-496b-b8c6-033a0ad89c67+3:2358:x1873884678823680:12345-192.168.204.50@tcp:251:umount.0 Request processed in 163us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076000.480104:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 299 00000020:00010000:2.0:1787076000.480511:0:5840:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9961bfdc9000: total 0 00010000:00010000:2.0:1787076000.480516:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076000.480557:0:5840:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9961bfdc9000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787076000.480592:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961b9032a00/0x859911ad6869f4e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623337 expref: 2 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076000.480609:0:5840:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9961bfdc9000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787076000.480618:0:5840:0:(genops.c:906:class_export_put()) final put ffff9961bfdc9000/3fbce478-41bc-496b-b8c6-033a0ad89c67 00010000:00010000:2.0:1787076000.480635:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076000.480682:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076000.480685:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787076000.481020:0:12638:0:(genops.c:865:class_export_destroy()) destroying export ffff9961bfdc9000/3fbce478-41bc-496b-b8c6-033a0ad89c67 for MGS 00000020:00000080:1.0:1787076000.481065:0:12638:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961bfdca800 for MGS 00010000:00010000:2.0:1787076000.647891:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787076001.528163:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a850c61f-0242-4b36-8952-7b46dff1f2b9 00000020:00000080:0.0:1787076001.528174:0:6728:0:(genops.c:906:class_export_put()) final put ffff9961a6e01000/a850c61f-0242-4b36-8952-7b46dff1f2b9 00000020:00000080:1.0:1787076001.528240:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9961a6e01000/a850c61f-0242-4b36-8952-7b46dff1f2b9 for lustre-OST0000 00000020:00000080:1.0:1787076001.532106:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961a6e02000 for lustre-OST0000 00010000:00010000:2.0:1787076001.676795:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787076001.891021:0:12925:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787076001.911992:0:12925:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787076001.912042:0:12925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190039800/0x859911ad6869f520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f527 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.912072:0:12925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190039800/0x859911ad6869f520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f527 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.912081:0:12925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190039800/0x859911ad6869f520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f527 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.912089:0:12925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff996190039800/0x859911ad6869f520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f527 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.912154:0:12925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787076001.912160:0:12925:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787076001.912183:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787076001.912188:0:12925:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787076001.912194:0:12925:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787076001.912218:0:12925:0:(import.c:65:import_set_state_nolock()) ffff9961b4d4f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787076001.912346:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873884700819072:0@lo:39:umount.0 00000100:00100000:3.0:1787076001.912414:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076001.912518:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700819072 00000100:00100000:1.0:1787076001.912525:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700819072 00000100:00100000:1.0:1787076001.912574:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787076001.912582:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873884700819072:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787076001.912607:0:5852:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f29c 00000100:00080000:1.0:1787076001.912614:0:5852:0:(import.c:65:import_set_state_nolock()) ffff996191ba9000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787076001.912877:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787076001.912886:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996190039800/0x859911ad6869f520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f527 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076001.912895:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190039800 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:0.0:1787076001.912898:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996190039800/0x859911ad6869f520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f527 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076001.912906:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996190039800/0x859911ad6869f520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x859911ad6869f527 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787076001.912913:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996190039800/0x859911ad6869f520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x859911ad6869f527 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787076001.912931:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787076001.912933:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787076001.912935:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1787076001.913122:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1873884700819072:12345-0@lo:39:umount.0 Request processed in 539us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076001.913130:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787076001.913143:0:5852:0:(genops.c:906:class_export_put()) final put ffff996191bac000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787076001.913172:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff996191bac000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787076001.913215:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff996191ba9000 for lustre-MDT0000 00010000:00010000:1.0:1787076001.913243:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996190039800/0x859911ad6869f520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f527 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.913250:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787076001.913269:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996190039800/0x859911ad6869f520 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f527 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.913277:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996190039800/0x859911ad6869f520 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f527 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.913290:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076001.913297:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787076001.913354:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961b4d4f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787076001.913365:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873884700819072:0@lo:39:umount.0 00010000:00010000:2.0:1787076001.913509:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787076001.913520:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787076001.913523:0:12925:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787076001.913528:0:12925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1787076001.913719:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700819200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787076001.913768:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076001.913997:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700819200 00000100:00100000:0.0:1787076001.914003:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700819200 00000100:00100000:0.0:1787076001.914148:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787076001.914157:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a0260850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3312:x1873884700819200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787076001.914169:0:8465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787076001.914186:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996183be7c00/0x859911ad6869f527 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x859911ad6869f520 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076001.914200:0:8465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787076001.914239:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a0260850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:3312:x1873884700819200:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076001.914246:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787076001.914301:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700819200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787076001.915605:0:12925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f52e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f535 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.915621:0:12925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f52e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f535 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.915629:0:12925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f52e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f535 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.915923:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076001.915988:0:12925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f535 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.916042:0:12925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787076001.916049:0:12925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad6869f447 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f44e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.916056:0:12925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad6869f447 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f44e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.916063:0:12925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad6869f447 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f44e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.916069:0:12925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad6869f447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f44e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.916172:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787076001.916178:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f535 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.916187:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038800 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787076001.916191:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f535 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.916200:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f52e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x859911ad6869f535 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787076001.916207:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f52e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x859911ad6869f535 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787076001.916213:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787076001.916217:0:5840:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787076001.916247:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f52e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f535 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.916254:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787076001.916288:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f52e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f535 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.916295:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad6869f52e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f535 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.916323:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787076001.916326:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad6869f447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f44e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.916342:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522e00 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787076001.916345:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad6869f447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f44e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.916352:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad6869f447 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x859911ad6869f44e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787076001.916358:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad6869f447 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x859911ad6869f44e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787076001.916363:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787076001.916365:0:5840:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1787076001.916379:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad6869f447 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f44e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.916385:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787076001.916391:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad6869f447 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f44e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.916399:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076001.916400:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076001.916402:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787076001.916633:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700819456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787076001.916724:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076001.916849:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787076001.916860:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700819328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787076001.916884:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076001.917048:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700819456 00000100:00100000:1.0:1787076001.917057:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700819456 00000100:00100000:1.0:1787076001.917174:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700819328 00000100:00100000:1.0:1787076001.917178:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700819328 00000100:00100000:1.0:1787076001.917203:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787076001.917211:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+19:3314:x1873884700819456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787076001.917223:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787076001.917244:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996183be6200/0x859911ad6869f44e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x859911ad6869f447 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.917260:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787076001.917297:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+18:3314:x1873884700819456:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076001.917315:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787076001.917333:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787076001.917340:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+17:3314:x1873884700819328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787076001.917347:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787076001.917356:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961b9033800/0x859911ad6869f535 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x859911ad6869f52e expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.917364:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787076001.917386:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:3314:x1873884700819328:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076001.917391:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787076001.917427:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700819328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787076001.917436:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3314:1873884700819456:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787076001.917617:0:12925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787076001.917625:0:12925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad6869f447 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f44e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787076001.917667:0:12925:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787076001.917677:0:12925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe69000/0x859911ad6869f73b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f742 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.917684:0:12925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe69000/0x859911ad6869f73b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f742 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.917690:0:12925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe69000/0x859911ad6869f73b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f742 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.917704:0:12925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff9961bfe69000/0x859911ad6869f73b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f742 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.917865:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787076001.917870:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9961bfe69000/0x859911ad6869f73b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f742 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.917877:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69000 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787076001.917881:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9961bfe69000/0x859911ad6869f73b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f742 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.917888:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9961bfe69000/0x859911ad6869f73b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x859911ad6869f742 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787076001.917900:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9961bfe69000/0x859911ad6869f73b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x859911ad6869f742 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787076001.917905:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787076001.917907:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787076001.917926:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9961bfe69000/0x859911ad6869f73b lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f742 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.917932:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787076001.917966:0:12925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:2.0:1787076001.917971:0:12925:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:0.0:1787076001.917971:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700819584:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787076001.917977:0:12925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be7e00/0x859911ad6869f1fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f202 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.917984:0:12925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be7e00/0x859911ad6869f1fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f202 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.917991:0:12925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be7e00/0x859911ad6869f1fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f202 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.917997:0:12925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff996183be7e00/0x859911ad6869f1fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f202 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076001.918003:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787076001.918005:0:12925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787076001.918008:0:12925:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1787076001.918010:0:12925:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787076001.918038:0:12925:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787076001.918043:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787076001.918048:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787076001.918054:0:12925:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1787076001.918060:0:12925:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9961b4e1a000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787076001.918065:0:12925:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9961beb77000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1787076001.918066:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:2.0:1787076001.918073:0:12925:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9961b00b6000 3b46436a-eac8-40ba-903d-0628e5cbe0d3 192.168.204.50@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787076001.918078:0:12925:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9961b9e10000) has exports, disconnecting them 00000020:00080000:2.0:1787076001.918287:0:12925:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9961b4e1a000), last request at 1787075997 00000020:00000080:2.0:1787076001.918296:0:12925:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f40f 00000100:00080000:2.0:1787076001.918324:0:12925:0:(import.c:65:import_set_state_nolock()) ffff9961b4e19000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787076001.918335:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9961bfe69000/0x859911ad6869f73b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f742 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.918342:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9961bfe69000/0x859911ad6869f73b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f742 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.918352:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076001.918353:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076001.918355:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787076001.918366:0:12925:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9961b4e1a000): rc 0 00000020:00000080:2.0:1787076001.918369:0:12925:0:(genops.c:906:class_export_put()) final put ffff9961b4e1a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787076001.918384:0:12925:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9961beb77000), last request at 1787075997 00000020:00000080:2.0:1787076001.918387:0:12925:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f344 00000100:00080000:2.0:1787076001.918392:0:12925:0:(import.c:65:import_set_state_nolock()) ffff9961beb76000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787076001.918392:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700819584 00000100:00100000:0.0:1787076001.918397:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700819584 00000020:00080000:2.0:1787076001.918408:0:12925:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9961beb77000): rc 0 00000020:00000080:2.0:1787076001.918410:0:12925:0:(genops.c:906:class_export_put()) final put ffff9961beb77000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1787076001.918417:0:12925:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb0b1c0d4bae0 00000100:00100000:0.0:1787076001.918427:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787076001.918433:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+16:3311:x1873884700819584:12345-0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787076001.918435:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787076001.918438:0:12925:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00010000:00010000:0.0:1787076001.918441:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:2.0:1787076001.918450:0:12925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1787076001.918451:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961bf632200/0x859911ad6869f742 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x859911ad6869f73b expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076001.918460:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787076001.918488:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:3311:x1873884700819584:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076001.918495:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787076001.918522:0:12925:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787076001.918522:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700819584:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787076001.918535:0:12925:0:(import.c:65:import_set_state_nolock()) ffff9961b9cbe800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787076001.918551:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787076001.918554:0:12925:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1787076001.918562:0:12925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:1.0:1787076001.918608:0:12638:0:(genops.c:865:class_export_destroy()) destroying export ffff9961b4e1a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:2.0:1787076001.918622:0:12925:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787076001.918630:0:12925:0:(import.c:65:import_set_state_nolock()) ffff9961c180b000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:1.0:1787076001.918658:0:12638:0:(genops.c:865:class_export_destroy()) destroying export ffff9961beb77000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00080000:2.0:1787076001.918681:0:12925:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9961b9e10000) has no exports 00000020:00000080:1.0:1787076001.918698:0:12638:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961b4e19000 for lustre-MDT0000 00000020:00000080:1.0:1787076001.918702:0:12638:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961beb76000 for lustre-MDT0000 00000100:00100000:0.0:1787076001.919071:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700819712:0@lo:9:umount.0 00000100:00100000:0.0:1787076001.919172:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076001.919237:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700819840:0@lo:9:umount.0 00000100:00100000:0.0:1787076001.919260:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787076001.919325:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076001.919429:0:12926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076001.919432:0:12926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076001.919434:0:12926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787076001.919499:0:12484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700819712 00000100:00100000:1.0:1787076001.919504:0:12484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700819712 00000100:00100000:1.0:1787076001.919554:0:12484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700819840 00000100:00100000:1.0:1787076001.919557:0:12484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700819840 00000100:00100000:1.0:1787076001.919578:0:12484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787076001.919586:0:12484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b91bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1873884700819712:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787076001.919607:0:12484:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f39f 00000100:00080000:1.0:1787076001.919624:0:12484:0:(import.c:65:import_set_state_nolock()) ffff9961bf063000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787076001.919855:0:12484:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1787076001.920348:0:12484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b91bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3310:x1873884700819712:12345-0@lo:9:umount.0 Request processed in 760us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076001.920357:0:12484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787076001.920375:0:12484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787076001.920384:0:12484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a53de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1873884700819840:12345-0@lo:9:umount.0 00010000:00010000:2.0:1787076001.920478:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996183be7e00/0x859911ad6869f1fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f202 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.920488:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996183be7e00 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:2.0:1787076001.920492:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996183be7e00/0x859911ad6869f1fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f202 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.920511:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996183be7e00/0x859911ad6869f1fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x859911ad6869f202 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787076001.920518:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996183be7e00/0x859911ad6869f1fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x859911ad6869f202 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787076001.920524:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787076001.920526:0:5840:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787076001.920528:0:5840:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00000080:1.0:1787076001.920545:0:12484:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f478 00010000:00010000:2.0:1787076001.920550:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996183be7e00/0x859911ad6869f1fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f202 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.920556:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787076001.920573:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996183be7e00/0x859911ad6869f1fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f202 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.920580:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996183be7e00/0x859911ad6869f1fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f202 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076001.920593:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076001.920594:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076001.920596:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787076001.920603:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787076001.920613:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700819968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787076001.920663:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787076001.920731:0:12484:0:(import.c:65:import_set_state_nolock()) ffff9961bf061800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787076001.920833:0:12484:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787076001.921046:0:12484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a53de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3310:x1873884700819840:12345-0@lo:9:umount.0 Request processed in 663us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076001.921054:0:12484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787076001.921189:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787076001.921194:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787076001.921607:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700819968 00000100:00100000:1.0:1787076001.921614:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700819968 00000100:00100000:1.0:1787076001.921668:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787076001.921677:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+15:3311:x1873884700819968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787076001.921689:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787076001.921704:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996180030400/0x859911ad6869f202 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x859911ad6869f1fb expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076001.921720:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787076001.921771:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:3311:x1873884700819968:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076001.921778:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787076001.921816:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3311:1873884700819968:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787076001.921852:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961b9cbe800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787076001.921873:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787076001.921875:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787076001.921879:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700819712:0@lo:9:umount.0 00000100:00080000:1.0:1787076001.921894:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961c180b000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787076001.921903:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787076001.921905:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787076001.921908:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700819840:0@lo:9:umount.0 00010000:00010000:1.0:1787076001.921937:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076001.922449:0:12926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787076001.930422:0:12925:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9961b9e10000) has no exports 00000020:00000080:2.0:1787076001.987345:0:12925:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f256 00000020:00000080:2.0:1787076001.987443:0:12925:0:(genops.c:906:class_export_put()) final put ffff9961831c1800/lustre-QMT0000_UUID 00000020:01000000:2.0:1787076001.987466:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787076001.987610:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787076001.987612:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9961831c1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787076001.987622:0:12925:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787076001.987628:0:12925:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9961b9e03380) has no exports 00000020:00000080:0.0:1787076001.988177:0:12925:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f24f 00000020:00000080:0.0:1787076001.988183:0:12925:0:(genops.c:906:class_export_put()) final put ffff9961baee3000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787076001.988237:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787076001.988244:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787076001.988256:0:12925:0:(genops.c:906:class_export_put()) final put ffff9961b9e0c000/lustre-QMT0000_UUID 00000020:00000080:0.0:1787076001.988259:0:12925:0:(genops.c:865:class_export_destroy()) destroying export ffff9961b9e0c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787076001.988266:0:12925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1787076001.988861:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9961baee3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1787076002.505442:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873884700820224:0@lo:400:kworker.0 00000100:00100000:1.0:1787076002.505448:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873884700820352:0@lo:400:kworker.0 00000100:00100000:3.0:1787076002.505544:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b94b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700820096:0@lo:400:kworker.0 00000100:00100000:1.0:1787076002.505801:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076002.505866:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700820352 00000100:00100000:1.0:1787076002.505873:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700820352 00000100:00100000:1.0:1787076002.505908:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787076002.505915:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1873884700820352:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787076002.505923:0:5853:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787076002.505965:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1873884700820352:12345-0@lo:400:kworker.0 Request processed in 48us (164us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787076002.505972:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:1.0:1787076002.506009:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787076002.506014:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9961c1999800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787076002.506018:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1787076002.512573:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076002.512679:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700820224 00000100:00100000:0.0:1787076002.512688:0:7654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700820224 00000100:00100000:0.0:1787076002.512730:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787076002.512738:0:7654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3314:x1873884700820224:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787076002.512747:0:7654:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787076002.512795:0:7654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3314:x1873884700820224:12345-0@lo:400:kworker.0 Request processed in 56us (231us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787076002.512802:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1787076002.512846:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787076002.512851:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9961bf086800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787076002.512855:0:3314:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787076002.512860:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9961bf086800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787076002.512864:0:3314:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 180 00000100:00080000:0.0:1787076002.512870:0:3314:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9961bf086800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:0.0:1787076002.512897:0:3314:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9961b516ca80 x1873884700820480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787076002.512928:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1873884700820224:0@lo:400:kworker.0 00000100:00100000:0.0:1787076002.512978:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1873884700820480:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787076002.513011:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076002.513038:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700820480 00000100:00100000:0.0:1787076002.513055:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700820480 00000100:00100000:0.0:1787076002.513074:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787076002.513079:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1873884700820480:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1787076002.513093:0:5853:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1787076002.515260:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9961c1999800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787076002.515414:0:3311:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 198 00000100:00080000:1.0:1787076002.515424:0:3311:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9961c1999800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:1.0:1787076002.515559:0:3311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9961b52e6680 x1873884700820608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787076002.515589:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1873884700820352:0@lo:400:kworker.0 00000100:00100000:1.0:1787076002.515687:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1873884700820608:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787076002.515930:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076002.515998:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700820608 00000100:00100000:1.0:1787076002.516006:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700820608 00000100:00100000:1.0:1787076002.516039:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787076002.516045:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1873884700820608:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1787076002.516062:0:5852:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787076002.516107:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1873884700820608:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 61us (178us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787076002.516121:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1787076002.516156:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961c1999800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787076002.516161:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787076002.516164:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1873884700820608:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787076002.516430:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076002.516777:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700820096 00000100:00100000:2.0:1787076002.516783:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700820096 00000100:00100000:2.0:1787076002.516815:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787076002.516822:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:3313:x1873884700820096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787076002.516862:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191061450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:3313:x1873884700820096:12345-0@lo:400:kworker.0 Request processed in 41us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076002.516868:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787076002.516937:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b94b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700820096:0@lo:400:kworker.0 00000100:00100000:0.0:1787076002.538412:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1873884700820480:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 25322us (25390us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787076002.538427:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1787076002.538532:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961bf086800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787076002.538539:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787076002.538543:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1873884700820480:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:0.0:1787076002.696040:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076003.722776:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076004.743998:0:12926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787076005.104299:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787076005.104310:0:7657:0:(genops.c:906:class_export_put()) final put ffff9961bf061000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787076005.106023:0:12638:0:(genops.c:865:class_export_destroy()) destroying export ffff9961bf061000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787076005.106079:0:12638:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961bf061800 for lustre-OST0001 00000001:00100000:0.0:1787076005.123533:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3b46436a-eac8-40ba-903d-0628e5cbe0d3 00000001:00080000:0.0:1787076005.123554:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1787076005.123559:0:5874:0:(genops.c:906:class_export_put()) final put ffff9961b00b6000/3b46436a-eac8-40ba-903d-0628e5cbe0d3 00000020:00000080:3.0:1787076005.123628:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9961b00b6000/3b46436a-eac8-40ba-903d-0628e5cbe0d3 for lustre-MDT0000 00000020:00000080:3.0:1787076005.123711:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961b00b0000 for lustre-MDT0000 00010000:00010000:0.0:1787076005.767836:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787076006.691320:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787076006.691330:0:6728:0:(genops.c:906:class_export_put()) final put ffff9961bf060000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787076006.691500:0:12638:0:(genops.c:865:class_export_destroy()) destroying export ffff9961bf060000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787076006.691562:0:12638:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961bf063000 for lustre-OST0000 00010000:00010000:1.0:1787076006.791872:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787076007.624011:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787076007.624032:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787076007.624037:0:36:0:(import.c:65:import_set_state_nolock()) ffff9961bf086800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787076007.624046:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 384 00000100:00080000:3.0:1787076007.624051:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787076007.624058:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9961bf086800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1787076007.624083:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9961c1846680 x1873884700820864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787076007.624113:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787076007.624117:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787076007.624119:0:36:0:(import.c:65:import_set_state_nolock()) ffff9961c1999800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787076007.624122:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 384 00000100:00080000:3.0:1787076007.624125:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787076007.624128:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9961c1999800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1787076007.624140:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9961c1845f80 x1873884700820992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787076007.624231:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1873884700820864:0@lo:38:kworker.0 00000100:00100000:0.0:1787076007.624308:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076007.624390:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1873884700820992:0@lo:38:kworker.0 00000100:00100000:0.0:1787076007.624415:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076007.624463:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700820864 00000100:00100000:0.0:1787076007.624471:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700820864 00000100:00100000:0.0:1787076007.624498:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700820992 00000100:00100000:0.0:1787076007.624501:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700820992 00000100:00100000:0.0:1787076007.624516:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787076007.624523:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b94b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1873884700820864:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1787076007.624541:0:5852:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787076007.627358:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787076007.627370:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1873884700820992:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787076007.627392:0:5854:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787076007.627505:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1873884700820992:12345-0@lo:38:kworker.0 Request processed in 135us (3089us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787076007.627514:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:3.0:1787076007.627596:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961c1999800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787076007.627601:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787076007.627605:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1873884700820992:0@lo:38:kworker.0 00000100:00100000:2.0:1787076007.627718:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700820736:0@lo:400:kworker.0 00000100:00100000:2.0:1787076007.627763:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076007.627857:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700820736 00000100:00100000:3.0:1787076007.627881:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700820736 00000100:00100000:3.0:1787076007.627928:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1787076007.627934:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996191062450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:3312:x1873884700820736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787076007.627971:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996191062450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f837e7e9-66a9-4dbd-86cd-a110c11486d7+14:3312:x1873884700820736:12345-0@lo:400:kworker.0 Request processed in 38us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076007.627978:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787076007.628052:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700820736:0@lo:400:kworker.0 00000100:00100000:0.0:1787076007.637234:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b94b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1873884700820864:12345-0@lo:38:kworker.0 Request processed in 12699us (12915us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787076007.637250:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:3.0:1787076007.637959:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961bf086800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787076007.637965:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787076007.637969:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1873884700820864:0@lo:38:kworker.0 00010000:00010000:2.0:1787076007.816286:0:12926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787076008.072237:0:12925:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff996187cca2a0 - data ffff9961bf913ca8/ffff9961bfd5b000 00000020:01000000:0.0:1787076008.072382:0:12925:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9961baf22f00 - data ffff9961a6b42510/ffff9961a02a6c00 00000001:00000004:0.0:1787076008.089398:0:12925:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:3.0:1787076008.192384:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787076008.192393:0:12925:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1787076008.192491:0:12925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787076008.192495:0:12925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787076008.197224:0:6984:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787076008.197232:0:6984:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1787076008.197248:0:6984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787076008.198626:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787076008.198633:0:12925:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1787076008.198674:0:12925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787076008.198677:0:12925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787076008.199667:0:7836:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787076008.199674:0:7836:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1787076008.199686:0:7836:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787076008.280748:0:12925:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f21e 00000020:00000080:3.0:1787076008.280764:0:12925:0:(genops.c:906:class_export_put()) final put ffff9961b9e0e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787076008.280862:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9961b9e0e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787076008.283415:0:12925:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f233 00000020:00000080:3.0:1787076008.283430:0:12925:0:(genops.c:906:class_export_put()) final put ffff996183dca800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787076008.283443:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787076008.283449:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787076008.283458:0:12925:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787076008.283463:0:12925:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9961b9e04d40) has no exports 00000020:00000080:1.0:1787076008.283500:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff996183dca800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1787076008.283635:0:12925:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787076008.283669:0:12925:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f471 00000020:00000080:3.0:1787076008.283673:0:12925:0:(genops.c:906:class_export_put()) final put ffff9961bfdcf000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787076008.283682:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787076008.283685:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787076008.283700:0:12925:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787076008.283703:0:12925:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9961c1804d40) has no exports 00000020:00000080:3.0:1787076008.283710:0:12925:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f46a 00000020:00000080:3.0:1787076008.283713:0:12925:0:(genops.c:906:class_export_put()) final put ffff9961c1808000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1787076008.284191:0:12925:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787076008.284196:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787076008.284201:0:12925:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1787076008.284206:0:12925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787076008.284209:0:12925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787076008.284240:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787076008.284247:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787076008.284252:0:12925:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f38a 00000020:00000080:3.0:1787076008.284257:0:12925:0:(genops.c:906:class_export_put()) final put ffff9961b9c82000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787076008.284260:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787076008.284264:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787076008.284267:0:12925:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787076008.284270:0:12925:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9961b009cd40) has no exports 00000020:00000080:3.0:1787076008.284273:0:12925:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f383 00000020:00000080:3.0:1787076008.284275:0:12925:0:(genops.c:906:class_export_put()) final put ffff9961b9cb9000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787076008.284424:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9961bfdcf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787076008.284436:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9961c1808000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787076008.284444:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961c180b000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787076008.284450:0:36:0:(genops.c:906:class_export_put()) final put ffff9961c180a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787076008.284453:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9961c180a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787076008.284459:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787076008.284536:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9961b9c82000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787076008.284545:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9961b9cb9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787076008.284808:0:12925:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787076008.284811:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787076008.284813:0:12925:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1787076008.284817:0:12925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787076008.284818:0:12925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787076008.284856:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787076008.284863:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787076008.284886:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787076008.284889:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787076008.284893:0:12925:0:(genops.c:906:class_export_put()) final put ffff99619838c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787076008.284895:0:12925:0:(genops.c:865:class_export_destroy()) destroying export ffff99619838c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787076008.284901:0:12925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787076008.285032:0:12925:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f23a 00000020:00000080:3.0:1787076008.285047:0:12925:0:(genops.c:906:class_export_put()) final put ffff996183dce000/lustre-MDD0000_UUID 00000020:01000000:3.0:1787076008.285051:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787076008.285056:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787076008.285059:0:12925:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787076008.285062:0:12925:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9961b9e14d40) has no exports 00000020:00000080:3.0:1787076008.285163:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787076008.285167:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787076008.285172:0:12925:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f241 00000020:00000080:3.0:1787076008.285176:0:12925:0:(genops.c:906:class_export_put()) final put ffff996183dcc800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787076008.285192:0:12925:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9961a03a5800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787076008.285196:0:12925:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9961a03a5800 3 00000020:01000004:3.0:1787076008.285200:0:12925:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9961a03a5800 from lustre-MDT0000 00000020:00000080:3.0:1787076008.285219:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787076008.285224:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787076008.285227:0:12925:0:(genops.c:906:class_export_put()) final put ffff996191306800/lustre-MDT0000_UUID 00000020:00000080:3.0:1787076008.285229:0:12925:0:(genops.c:865:class_export_destroy()) destroying export ffff996191306800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787076008.285231:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961b9cbe800 for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787076008.285237:0:12925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:1.0:1787076008.285240:0:36:0:(genops.c:906:class_export_put()) final put ffff9961bf081000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787076008.285243:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9961bf081000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787076008.285248:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000004:3.0:1787076008.285271:0:12925:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1787076008.285276:0:12925:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787076008.285280:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787076008.285283:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787076008.285287:0:12925:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787076008.285294:0:12925:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9961a6f55000 f837e7e9-66a9-4dbd-86cd-a110c11486d7 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787076008.285299:0:12925:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff99619183b380) has exports, disconnecting them 00000020:00080000:3.0:1787076008.285304:0:12925:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9961a6f55000), last request at 1787075781 00000020:00000080:3.0:1787076008.285320:0:12925:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f1df 00000020:00010000:3.0:1787076008.285324:0:12925:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9961a6f55000: total 2 00000100:00080000:3.0:1787076008.285328:0:12925:0:(import.c:65:import_set_state_nolock()) ffff9961a6f57800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787076008.285334:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff996183dce000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787076008.285339:0:36:0:(genops.c:906:class_export_put()) final put ffff996184ed9800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787076008.285341:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff996184ed9800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787076008.285344:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00080000:3.0:1787076008.285466:0:12925:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9961a6f55000): rc 0 00000020:00080000:3.0:1787076008.285472:0:12925:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff99619183b380) has no exports 00000020:00000080:1.0:1787076008.285490:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff996183dcc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1787076008.285537:0:5844:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff996191040600:5844] 0 exiting: rc = 1 00000100:00100000:3.0:1787076008.285623:0:5847:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99619171f800:5847] 2 exiting: rc = 0 00000100:00100000:2.0:1787076008.285790:0:5846:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff996191041c00:5846] 1 exiting: rc = 0 00000100:00100000:3.0:1787076008.286084:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286095:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286102:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286108:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286114:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286121:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286127:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286133:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286140:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286147:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286153:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286159:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286164:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286170:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286175:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286192:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286198:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286206:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286212:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286218:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286223:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286230:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286236:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286243:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286249:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286255:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286261:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286267:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286273:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286279:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286286:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286291:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286321:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286326:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286332:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286347:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286353:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286360:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286365:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286371:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286376:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286381:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286386:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286391:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286397:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286527:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286534:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286542:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286548:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286553:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286559:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286565:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286571:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286577:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286582:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286588:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286594:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286599:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286606:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286612:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286617:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286622:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286628:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.286633:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1787076008.287019:0:12925:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787076008.287023:0:12925:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:0.0:1787076008.287729:0:5840:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9961a6f55000: total 0 00010000:00010000:0.0:1787076008.287777:0:5840:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9961a6f55000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787076008.287809:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181496a00/0x859911ad6869f543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x859911ad6869f53c expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076008.287827:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181523e00/0x859911ad6869f2f7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x859911ad6869f2f0 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076008.287840:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996190039e00/0x859911ad6869f4ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x859911ad6869f4e8 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076008.287853:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961b9032200/0x859911ad6869f50b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x859911ad6869f504 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076008.287864:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996183be6000/0x859911ad6869f4fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x859911ad6869f4f6 expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076008.287876:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961bfe69200/0x859911ad6869f734 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x859911ad6869f72d expref: 4 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076008.287885:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996183be6a00/0x859911ad6869f519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x859911ad6869f512 expref: 3 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076008.287909:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181523c00/0x859911ad6869f726 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x859911ad6869f71f expref: 2 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076008.287932:0:5840:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9961a6f55000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787076008.287946:0:5840:0:(genops.c:906:class_export_put()) final put ffff9961a6f55000/f837e7e9-66a9-4dbd-86cd-a110c11486d7 00010000:00010000:0.0:1787076008.287967:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076008.287970:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076008.287972:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787076008.288239:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9961a6f55000/f837e7e9-66a9-4dbd-86cd-a110c11486d7 for MGS 00000020:00000080:1.0:1787076008.288279:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961a6f57800 for MGS 00000020:01000000:2.0:1787076008.288373:0:12925:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff996187ccaa80 - data ffff9961bf860bd0/ffff9961bfd5a800 00000020:01000000:2.0:1787076008.288466:0:12925:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9961838ca540 - data ffff9961aa809e58/ffff9961b0242800 00000020:00000080:2.0:1787076008.289411:0:12925:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f1c3 00000020:00000080:2.0:1787076008.289420:0:12925:0:(genops.c:906:class_export_put()) final put ffff9961a03a2800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787076008.289433:0:12925:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9961a03a5800 from MGS, refs=2 00000020:01000004:2.0:1787076008.289436:0:12925:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9961a03a5800 2 00000020:01000004:2.0:1787076008.289440:0:12925:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9961a03a5800 from MGS 00000020:00000080:2.0:1787076008.289467:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787076008.289475:0:12925:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787076008.289477:0:12925:0:(genops.c:906:class_export_put()) final put ffff9961a03a6000/MGS 00000020:00000080:2.0:1787076008.289480:0:12925:0:(genops.c:865:class_export_destroy()) destroying export ffff9961a03a6000/MGS for MGS 00000020:01000000:2.0:1787076008.289487:0:12925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787076008.289542:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787076008.289546:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787076008.289552:0:12925:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787076008.289558:0:12925:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9961b4d4a800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787076008.289571:0:12925:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9961b00999c0) has exports, disconnecting them 00000020:00080000:2.0:1787076008.289576:0:12925:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9961b4d4a800), last request at 1787075782 00000020:00000080:2.0:1787076008.289580:0:12925:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f28e 00000020:00080000:2.0:1787076008.289587:0:12925:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9961b4d4a800): rc 0 00000020:00000080:2.0:1787076008.289591:0:12925:0:(genops.c:906:class_export_put()) final put ffff9961b4d4a800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787076008.289774:0:12638:0:(genops.c:865:class_export_destroy()) destroying export ffff9961a03a2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787076008.289786:0:12638:0:(genops.c:865:class_export_destroy()) destroying export ffff9961b4d4a800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787076008.290397:0:12925:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787076008.290404:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787076008.290408:0:12925:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787076008.290414:0:12925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787076008.290491:0:12638:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961b4d4f800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787076008.290540:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787076008.290546:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787076008.290550:0:12925:0:(genops.c:906:class_export_put()) final put ffff9961c14df000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787076008.290553:0:12925:0:(genops.c:865:class_export_destroy()) destroying export ffff9961c14df000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787076008.290558:0:12925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787076008.290612:0:12925:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9961a03a5800 1 00000020:00000080:2.0:1787076008.290616:0:12925:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f1b5 00000020:00000080:2.0:1787076008.290621:0:12925:0:(genops.c:906:class_export_put()) final put ffff9961a03a7000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787076008.290635:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787076008.290664:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787076008.290668:0:12925:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787076008.290672:0:12925:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff99619183cd40) has no exports 00000020:00000080:3.0:1787076008.290673:0:12638:0:(genops.c:865:class_export_destroy()) destroying export ffff9961a03a7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787076008.345250:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787076008.345266:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787076008.345272:0:12925:0:(genops.c:906:class_export_put()) final put ffff9961a03a4800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787076008.345277:0:12925:0:(genops.c:865:class_export_destroy()) destroying export ffff9961a03a4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787076008.345286:0:12925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787076008.345457:0:12925:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9961a03a3800 00000020:01000000:3.0:1787076008.345484:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787076008.345489:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787076008.345492:0:12925:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787076008.345496:0:12925:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9961918399c0) has no exports 00000100:00100000:3.0:1787076008.345579:0:5853:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9961919c1e00:5853] 1 exiting: rc = 0 00000100:00100000:1.0:1787076008.345632:0:5854:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9961919c1c00:5854] 2 exiting: rc = 0 00000100:00100000:1.0:1787076008.345735:0:7654:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9961bf1a1800:7654] 3 exiting: rc = 0 00000100:00100000:1.0:1787076008.347751:0:5852:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9961919c0a00:5852] 0 exiting: rc = 1 00000100:00100000:3.0:1787076008.348257:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348266:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348271:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348277:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348282:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348288:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348293:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348299:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348304:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348309:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348314:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348340:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348347:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348353:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348358:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348363:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348369:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348374:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348380:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348386:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348391:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348409:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348415:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348420:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348436:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348442:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348448:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348453:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348459:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348464:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348471:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348477:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348482:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348488:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348493:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348498:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348504:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348509:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348514:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348519:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348525:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348530:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348536:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348541:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348546:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348551:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348556:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348562:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348568:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348573:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348579:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348585:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348590:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348596:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348601:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348606:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348619:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348624:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348631:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348664:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348671:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348677:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348682:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.348689:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787076008.353999:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99619cd83000:5855] 0 exiting: rc = 1 00000100:00100000:0.0:1787076008.354486:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99619cd82800:5856] 1 exiting: rc = 0 00000100:00100000:3.0:1787076008.354789:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354803:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354810:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354816:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354822:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354828:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354833:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354839:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354844:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354849:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354854:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354861:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354870:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354875:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354880:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354885:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354890:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354895:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354900:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354905:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354911:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354916:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354922:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354927:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354932:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354937:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354943:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354963:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354968:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354973:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354978:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354983:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354988:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.354993:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355000:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355004:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355009:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355014:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355019:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355024:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355029:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355034:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355040:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355045:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355050:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355055:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355060:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355065:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355070:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355075:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355081:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355086:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355090:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355095:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355102:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355108:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355198:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355206:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355211:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355215:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355221:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355226:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355240:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.355246:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787076008.359412:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff99619ce6ac00:5857] 0 exiting: rc = 1 00000100:00100000:1.0:1787076008.359683:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff99619ce6be00:5858] 1 exiting: rc = 0 00000100:00100000:3.0:1787076008.359813:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359832:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359849:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359856:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359862:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359868:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359874:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359881:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359889:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359896:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359902:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359910:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359917:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359923:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359947:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359958:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359965:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359973:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359983:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359990:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.359997:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360003:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360009:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360016:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360022:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360028:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360052:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360060:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360066:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360072:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360080:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360086:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360092:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360108:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360129:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360136:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360142:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360148:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360168:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360176:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360192:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360198:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360205:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360211:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360216:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360222:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360228:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360234:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360240:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360246:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360269:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360277:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360284:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360291:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360299:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360308:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360318:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360497:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360506:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360512:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360519:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360525:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360532:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.360547:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076008.372634:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff996184d95a00:5859] 0 exiting: rc = 1 00000100:00100000:1.0:1787076008.372837:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99619ce6a800:5860] 1 exiting: rc = 0 00000100:00100000:3.0:1787076008.372933:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.372941:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.372947:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.372952:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.372969:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.372974:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.372979:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.372984:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.372988:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.372993:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.372998:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373003:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373008:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373013:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373018:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373023:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373028:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373033:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373037:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373042:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373047:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373051:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373056:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373060:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373064:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373068:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373073:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373078:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373082:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373087:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373091:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373096:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373101:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373106:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373111:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373128:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373133:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373138:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373143:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373155:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373160:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373165:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373170:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373174:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373190:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373196:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373201:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373207:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373213:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373219:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373224:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373230:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373235:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373240:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373244:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373249:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373253:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373258:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373263:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373267:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373271:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373276:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373280:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.373285:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787076008.373919:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff996184d95600:5862] 1 exiting: rc = 0 00000100:00100000:0.0:1787076008.374044:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff99619ce6b800:5861] 0 exiting: rc = 1 00000100:00100000:3.0:1787076008.374129:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374136:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374141:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374147:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374152:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374158:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374163:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374168:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374174:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374190:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374206:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374211:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374217:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374222:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374227:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374232:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374237:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374242:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374247:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374252:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374257:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374262:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374267:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374272:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374277:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374282:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374287:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374293:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374298:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374303:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374309:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374314:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374320:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374507:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374513:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374519:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374524:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374530:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374535:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374540:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374546:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374551:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374557:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374562:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374568:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374582:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374587:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374593:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374598:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374603:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374608:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374613:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374618:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374623:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374629:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374634:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374671:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374678:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374683:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374688:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374693:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374698:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374703:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.374708:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787076008.375076:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9961894bb800:5864] 1 exiting: rc = 0 00000100:00100000:0.0:1787076008.375231:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9961894bba00:5863] 0 exiting: rc = 1 00000100:00100000:3.0:1787076008.375305:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375313:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375318:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375399:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375407:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375412:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375417:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375494:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375502:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375507:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375512:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375517:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375522:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375527:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375532:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375537:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375552:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375558:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375563:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375568:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375573:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375578:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375583:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375588:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375593:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375599:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375604:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375609:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375614:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375619:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375624:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375629:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375634:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375806:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375813:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375819:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375825:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375830:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375836:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375841:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375846:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375851:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375856:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375862:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375867:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375872:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375877:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375882:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375888:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375893:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375898:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375914:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375919:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375924:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375929:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375934:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375939:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375943:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375948:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375952:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375957:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375962:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375967:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.375972:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787076008.377062:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9961a03ccc00:5865] 0 exiting: rc = 1 00000100:00100000:3.0:1787076008.377411:0:5867:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9961a03cd000:5867] 2 exiting: rc = 0 00000100:00100000:0.0:1787076008.377816:0:5866:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9961894baa00:5866] 1 exiting: rc = 0 00000100:00100000:3.0:1787076008.378335:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378344:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378349:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378354:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378359:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378364:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378369:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378375:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378381:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378387:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378395:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378400:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378406:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378412:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378417:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378547:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378557:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378582:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378590:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378596:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378602:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378619:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378625:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378631:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378667:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378674:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378680:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378687:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378692:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378698:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378705:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378711:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378716:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378723:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378728:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378735:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378741:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378747:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378752:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378758:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378764:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378785:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378792:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378798:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378804:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378810:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378816:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378821:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378827:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378832:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378838:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378845:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378851:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378856:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378862:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378868:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378883:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378888:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378894:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378900:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378905:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378911:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378917:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076008.378923:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787076008.384963:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787076008.384978:0:12925:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787076008.384984:0:12925:0:(genops.c:906:class_export_put()) final put ffff9961b00b2800/MDS_uuid 00000020:00000080:3.0:1787076008.384988:0:12925:0:(genops.c:865:class_export_destroy()) destroying export ffff9961b00b2800/MDS_uuid for MDS 00000020:01000000:3.0:1787076008.384995:0:12925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787076008.385133:0:12925:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787076008.839927:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076009.864513:0:12926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076010.888356:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787076011.361473:0:13080:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787076011.379981:0:13080:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787076011.380034:0:13080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f50b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076011.380051:0:13080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f50b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076011.380059:0:13080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f50b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076011.380066:0:13080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f50b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076011.380092:0:13080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787076011.380098:0:13080:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787076011.380137:0:13080:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787076011.380142:0:13080:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787076011.380147:0:13080:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787076011.380167:0:13080:0:(import.c:65:import_set_state_nolock()) ffff9961bf086800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787076011.380171:0:13080:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787076011.380173:0:13080:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787076011.380176:0:13080:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787076011.380858:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787076011.380866:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f50b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076011.380875:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996183be6800 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787076011.380879:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f50b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076011.380887:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x859911ad6869f50b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787076011.380894:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x859911ad6869f50b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787076011.380900:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787076011.380903:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787076011.380906:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787076011.380953:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f504 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f50b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076011.380960:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787076011.380995:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f504 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f50b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076011.381002:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996183be6800/0x859911ad6869f504 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f50b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076011.381027:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076011.381030:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076011.381031:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787076011.381084:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700821120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787076011.381163:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076011.381306:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700821120 00000100:00100000:1.0:1787076011.381314:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700821120 00000100:00100000:1.0:1787076011.381359:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787076011.381366:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3313:x1873884700821120:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787076011.381373:0:5836:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787076011 with bad export cookie 9626745114959933919 00010000:00010000:3.0:1787076011.383491:0:13080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181497e00/0x859911ad6869f512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f519 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076011.383511:0:13080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181497e00/0x859911ad6869f512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f519 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076011.383519:0:13080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181497e00/0x859911ad6869f512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f519 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076011.383526:0:13080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff996181497e00/0x859911ad6869f512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f519 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076011.385921:0:13080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787076011.385944:0:13080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bf633a00/0x859911ad6869f72d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f734 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076011.385956:0:13080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bf633a00/0x859911ad6869f72d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f734 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076011.385962:0:13080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bf633a00/0x859911ad6869f72d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f734 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076011.385968:0:13080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff9961bf633a00/0x859911ad6869f72d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f734 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076011.387364:0:12926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787076011.387377:0:12926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181497e00/0x859911ad6869f512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f519 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076011.387388:0:12926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181497e00 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:0.0:1787076011.387392:0:12926:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181497e00/0x859911ad6869f512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f519 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076011.387403:0:12926:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181497e00/0x859911ad6869f512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x859911ad6869f519 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787076011.387410:0:12926:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181497e00/0x859911ad6869f512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x859911ad6869f519 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787076011.387438:0:12926:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787076011.387441:0:12926:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1787076011.387483:0:12926:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181497e00/0x859911ad6869f512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f519 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076011.387490:0:12926:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787076011.387533:0:12926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181497e00/0x859911ad6869f512 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f519 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076011.387540:0:12926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181497e00/0x859911ad6869f512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f519 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076011.387559:0:12926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787076011.387563:0:12926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9961bf633a00/0x859911ad6869f72d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f734 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076011.387569:0:12926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633a00 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:0.0:1787076011.387572:0:12926:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9961bf633a00/0x859911ad6869f72d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f734 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076011.387579:0:12926:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9961bf633a00/0x859911ad6869f72d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x859911ad6869f734 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787076011.387586:0:12926:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9961bf633a00/0x859911ad6869f72d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x859911ad6869f734 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787076011.387591:0:12926:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787076011.387594:0:12926:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1787076011.387607:0:12926:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9961bf633a00/0x859911ad6869f72d lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f734 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076011.387623:0:12926:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787076011.387675:0:12926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9961bf633a00/0x859911ad6869f72d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f734 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076011.387684:0:12926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076011.387685:0:12926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076011.387687:0:12926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787076011.388198:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787076011.388223:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700821248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787076011.388308:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076011.388365:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787076011.388374:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700821376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787076011.388412:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076011.388447:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700821248 00000100:00100000:2.0:1787076011.388457:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700821248 00000100:00100000:2.0:1787076011.388488:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700821376 00000100:00100000:2.0:1787076011.388491:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700821376 00000100:00100000:2.0:1787076011.388506:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787076011.388513:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3313:x1873884700821248:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787076011.388520:0:5837:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787076011 with bad export cookie 9626745114959933919 00000100:00100000:2.0:1787076011.388562:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3313:x1873884700821248:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (253us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787076011.388570:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787076011.388586:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787076011.388591:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a0261050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3312:x1873884700821376:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787076011.388595:0:5837:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787076011 with bad export cookie 9626745114959933919 00000100:00100000:2.0:1787076011.388624:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a0261050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3312:x1873884700821376:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (211us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787076011.388629:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787076011.388687:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787076011.388691:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9961918af000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787076011.388695:0:3312:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.150@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1787076011.394392:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3313:x1873884700821120:12345-0@lo:103:ldlm_bl.0 Request processed in 13018us (13222us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787076011.394407:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1787076011.394595:0:13080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787076011.394621:0:13080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9961bf633a00/0x859911ad6869f72d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x859911ad6869f734 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787076011.394669:0:13080:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1787076011.394675:0:13080:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1787076011.394678:0:13080:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787076011.394719:0:13080:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787076011.394724:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787076011.394729:0:13080:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787076011.394735:0:13080:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787076011.394740:0:13080:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9961b9e119c0) has no exports 00000020:00080000:3.0:1787076011.394769:0:13080:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9961b9e119c0) has no exports 00000020:01000000:3.0:1787076011.397380:0:13080:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff996187cca600 - data ffff9961aaa52ca8/ffff9961baed1400 00000020:01000000:3.0:1787076011.397543:0:13080:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9961b9847ba0 - data ffff9961aa868288/ffff9961bf04e000 00010000:00010000:0.0:1787076011.397823:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787076011.399465:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787076011.423480:0:3312:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.150@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787076011.423487:0:3312:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787076011.423497:0:3312:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9961b52e6680 x1873884700821120/t0(0) o103->MGC192.168.204.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787076027 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787076011.423513:0:3312:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff996184e8f800 x1873884700821248/t0(0) o103->MGC192.168.204.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787076027 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787076011.423522:0:3312:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff996184e8ce00 x1873884700821376/t0(0) o103->MGC192.168.204.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787076027 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787076011.423557:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787076011.423560:0:3312:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787076011.423561:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787076011.424718:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9961918af000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787076011.424800:0:3312:0:(import.c:510:import_select_connection()) MGC192.168.204.150@tcp: connect to NID 0@lo last attempt 163 00000100:00080000:2.0:1787076011.424811:0:3312:0:(import.c:624:import_select_connection()) MGC192.168.204.150@tcp: import ffff9961918af000 using connection 192.168.204.150@tcp/0@lo 00000100:00080000:0.0:1787076011.424966:0:3313:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9961918af000 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:3.0:1787076011.425094:0:3312:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9961c1844000 x1873884700821504/t0(0) o250->MGC192.168.204.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787076011.425145:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3312:1873884700821376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787076011.425162:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3310:1873884700821504:0@lo:250:ptlrpcd_00_01.0 00000100:00100000:1.0:1787076011.425209:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700821120:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1787076011.425218:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873884700821504 offset 0 length 520: 4 00000100:00100000:1.0:1787076011.425226:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3313:1873884700821248:0@lo:103:ldlm_bl.0 00100000:10000000:3.0:1787076011.460419:0:13080:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787076011.514540:0:13080:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f313 00000020:00000080:2.0:1787076011.514551:0:13080:0:(genops.c:906:class_export_put()) final put ffff9961beb72800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787076011.514574:0:13080:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9961c14da000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787076011.514577:0:13080:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9961c14da000 2 00000020:01000004:2.0:1787076011.514581:0:13080:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9961c14da000 from lustre-OST0000 00000020:00000080:2.0:1787076011.514609:0:13080:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787076011.514620:0:13080:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787076011.514623:0:13080:0:(genops.c:906:class_export_put()) final put ffff9961beb74000/lustre-OST0000_UUID 00000020:00000080:2.0:1787076011.514626:0:13080:0:(genops.c:865:class_export_destroy()) destroying export ffff9961beb74000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787076011.514633:0:13080:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787076011.514709:0:13080:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787076011.514714:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787076011.514718:0:13080:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787076011.514723:0:13080:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00000080:3.0:1787076011.514892:0:12638:0:(genops.c:865:class_export_destroy()) destroying export ffff9961beb72800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:2.0:1787076011.515333:0:13080:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9961bf081800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787076011.515340:0:13080:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9961b0098000) has exports, disconnecting them 00000020:00080000:2.0:1787076011.515345:0:13080:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9961bf081800), last request at 1787075798 00000020:00000080:2.0:1787076011.515350:0:13080:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f33d 00000020:00080000:2.0:1787076011.515363:0:13080:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9961bf081800): rc 0 00000020:00000080:2.0:1787076011.515369:0:13080:0:(genops.c:906:class_export_put()) final put ffff9961bf081800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787076011.515708:0:12638:0:(genops.c:865:class_export_destroy()) destroying export ffff9961bf081800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787076011.516767:0:13080:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787076011.516774:0:13080:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787076011.516778:0:13080:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787076011.516784:0:13080:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787076011.516811:0:12638:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961bf086800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787076011.516932:0:13080:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787076011.516940:0:13080:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787076011.516944:0:13080:0:(genops.c:906:class_export_put()) final put ffff9961b9cbb800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787076011.516947:0:13080:0:(genops.c:865:class_export_destroy()) destroying export ffff9961b9cbb800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787076011.516965:0:13080:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1787076011.517036:0:13080:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9961c14da000 1 00000020:00000080:3.0:1787076011.517043:0:13080:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f2cd 00000020:00000080:3.0:1787076011.517049:0:13080:0:(genops.c:906:class_export_put()) final put ffff9961baee4000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787076011.517057:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787076011.517066:0:12638:0:(genops.c:865:class_export_destroy()) destroying export ffff9961baee4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787076011.517076:0:13080:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787076011.517080:0:13080:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787076011.517084:0:13080:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9961b9e13380) has no exports 00000020:00000080:0.0:1787076011.542365:0:13080:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787076011.542386:0:13080:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787076011.542392:0:13080:0:(genops.c:906:class_export_put()) final put ffff9961c14dd000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787076011.542397:0:13080:0:(genops.c:865:class_export_destroy()) destroying export ffff9961c14dd000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787076011.542405:0:13080:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787076011.542565:0:13080:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9961c14df800 00000020:02000400:0.0:1787076011.542622:0:13080:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787076011.911914:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787076012.750824:0:12638:0:(pinger.c:229:ptlrpc_pinger_process_import()) f837e7e9-66a9-4dbd-86cd-a110c11486d7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787076012.750833:0:12638:0:(pinger.c:247:ptlrpc_pinger_process_import()) f837e7e9-66a9-4dbd-86cd-a110c11486d7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787076012.750836:0:12638:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787076012.750839:0:12638:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787076012.750845:0:12638:0:(import.c:65:import_set_state_nolock()) ffff9961c1999800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787076012.750853:0:12638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 389 00000100:00080000:1.0:1787076012.750858:0:12638:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787076012.750865:0:12638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9961c1999800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:1.0:1787076012.750901:0:12638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9961b52e6680 x1873884700821632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787076012.754780:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1873884700821632:0@lo:38:kworker.0 00000400:00000100:2.0:1787076012.754844:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873884700821632 offset 0 length 520: 4 00010000:00010000:2.0:1787076012.936942:0:12926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076013.959931:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787076014.472039:0:13229:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787076014.484776:0:13229:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787076014.484850:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033000/0x859911ad6869f4e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f4ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076014.484865:0:13229:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033000/0x859911ad6869f4e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f4ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076014.484885:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033000/0x859911ad6869f4e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f4ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076014.484892:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff9961b9033000/0x859911ad6869f4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f4ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076014.485592:0:13229:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787076014.485601:0:13229:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787076014.485633:0:13229:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787076014.485670:0:13229:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9961b52e6680 x1873884700821632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787076032 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787076014.486400:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076014.486411:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9961b9033000/0x859911ad6869f4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f4ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076014.486422:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9033000 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:2.0:1787076014.486426:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9961b9033000/0x859911ad6869f4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f4ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076014.486436:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9961b9033000/0x859911ad6869f4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x859911ad6869f4ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787076014.486443:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9961b9033000/0x859911ad6869f4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x859911ad6869f4ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787076014.486793:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787076014.486799:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787076014.486802:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787076014.486819:0:5839:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9961918af000 00010000:00010000:2.0:1787076014.486823:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9961b9033000/0x859911ad6869f4e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x859911ad6869f4ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076014.486830:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9961b9033000/0x859911ad6869f4e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x859911ad6869f4ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076014.486845:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076014.486847:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076014.486861:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787076014.490248:0:13229:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787076014.490350:0:13229:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787076014.490359:0:13229:0:(import.c:65:import_set_state_nolock()) ffff9961c1999800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787076014.490383:0:13229:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787076014.490392:0:13229:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9961b52e6680 x1873884700821632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787076032 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787076014.490404:0:13229:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787076014.490407:0:13229:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:2.0:1787076014.490530:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1873884700821632:0@lo:38:kworker.0 00010000:00010000:3.0:1787076014.493567:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033a00/0x859911ad6869f4f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f4fd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076014.495256:0:13229:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033a00/0x859911ad6869f4f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f4fd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076014.495268:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033a00/0x859911ad6869f4f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f4fd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076014.495275:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff9961b9033a00/0x859911ad6869f4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f4fd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076014.495307:0:13229:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787076014.495315:0:13229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033600/0x859911ad6869f71f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad6869f726 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076014.495321:0:13229:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033600/0x859911ad6869f71f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad6869f726 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076014.495326:0:13229:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961b9033600/0x859911ad6869f71f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f726 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076014.495332:0:13229:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff9961b9033600/0x859911ad6869f71f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x859911ad6869f726 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076014.495366:0:12926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076014.495478:0:12926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9961b9033a00/0x859911ad6869f4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f4fd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076014.495488:0:12926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9033a00 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:2.0:1787076014.495492:0:12926:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9961b9033a00/0x859911ad6869f4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f4fd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076014.495502:0:12926:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9961b9033a00/0x859911ad6869f4f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x859911ad6869f4fd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787076014.495509:0:12926:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9961b9033a00/0x859911ad6869f4f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x859911ad6869f4fd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787076014.495516:0:12926:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787076014.495518:0:12926:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1787076014.495529:0:12926:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9961918af000 00010000:00010000:2.0:1787076014.495532:0:12926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9961b9033a00/0x859911ad6869f4f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x859911ad6869f4fd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076014.495538:0:12926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9961b9033a00/0x859911ad6869f4f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x859911ad6869f4fd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076014.496354:0:12926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787076014.496363:0:13229:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787076014.496363:0:12926:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9961b9033600/0x859911ad6869f71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f726 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787076014.496373:0:13229:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1787076014.496378:0:13229:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787076014.496407:0:13229:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787076014.496411:0:13229:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787076014.496418:0:13229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787076014.496424:0:13229:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787076014.496429:0:13229:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9961c1800000) has no exports 00000020:00080000:3.0:1787076014.496453:0:13229:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9961c1800000) has no exports 00010000:00010000:2.0:1787076014.496507:0:12926:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961b9033600 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:2.0:1787076014.496522:0:12926:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9961b9033600/0x859911ad6869f71f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x859911ad6869f726 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076014.496531:0:12926:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9961b9033600/0x859911ad6869f71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x859911ad6869f726 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787076014.496539:0:12926:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9961b9033600/0x859911ad6869f71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x859911ad6869f726 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787076014.496545:0:12926:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787076014.496547:0:12926:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787076014.496550:0:12926:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787076014.496559:0:12926:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9961918af000 00010000:00010000:2.0:1787076014.496562:0:12926:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9961b9033600/0x859911ad6869f71f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x859911ad6869f726 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076014.496569:0:12926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9961b9033600/0x859911ad6869f71f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x859911ad6869f726 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076014.496585:0:12926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076014.496587:0:12926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076014.496588:0:12926:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076014.497690:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787076014.500624:0:13229:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9961c18677e0 - data ffff9961bfa5ee58/ffff9961bf76ec00 00000020:01000000:3.0:1787076014.500802:0:13229:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9961a03a86c0 - data ffff9961bf90abd0/ffff9961bfd5cc00 00100000:10000000:3.0:1787076014.520626:0:13229:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787076014.543927:0:13229:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f3de 00000020:00000080:1.0:1787076014.543937:0:13229:0:(genops.c:906:class_export_put()) final put ffff9961c180d000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787076014.543954:0:13229:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9961bf681000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787076014.543957:0:13229:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9961bf681000 2 00000020:01000004:1.0:1787076014.543961:0:13229:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9961bf681000 from lustre-OST0001 00000020:00000080:1.0:1787076014.544005:0:13229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787076014.544023:0:13229:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787076014.544026:0:13229:0:(genops.c:906:class_export_put()) final put ffff9961c1808800/lustre-OST0001_UUID 00000020:00000080:1.0:1787076014.544029:0:13229:0:(genops.c:865:class_export_destroy()) destroying export ffff9961c1808800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787076014.544037:0:13229:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787076014.544140:0:13229:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f837e7e9-66a9-4dbd-86cd-a110c11486d7->MGS 00010000:00010000:1.0:1787076014.544155:0:13229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996190039c00/0x859911ad6869f2f0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x859911ad6869f2f7 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787076014.544168:0:13229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996190039c00/0x859911ad6869f2f0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x859911ad6869f2f7 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787076014.544174:0:13229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787076014.544184:0:13229:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787076014.544187:0:13229:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787076014.544207:0:13229:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9961918af000 00010000:00010000:1.0:1787076014.544212:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996190039c00/0x859911ad6869f2f0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x859911ad6869f2f7 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076014.544229:0:13229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9961b9033e00/0x859911ad6869f53c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x859911ad6869f543 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787076014.544235:0:13229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9961b9033e00/0x859911ad6869f53c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x859911ad6869f543 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787076014.544255:0:13229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787076014.544257:0:13229:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787076014.544259:0:13229:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787076014.544271:0:13229:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9961918af000 00010000:00010000:1.0:1787076014.544275:0:13229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9961b9033e00/0x859911ad6869f53c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x859911ad6869f543 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787076014.544292:0:13229:0:(import.c:65:import_set_state_nolock()) ffff9961918af000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787076014.544296:0:13229:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787076014.544298:0:13229:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787076014.544300:0:13229:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787076014.544304:0:13229:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787076014.544314:0:13229:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9961c1844000 x1873884700821504/t0(0) o250->MGC192.168.204.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787076021 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787076014.544330:0:13229:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787076014.544332:0:13229:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1787076014.544481:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f837e7e9-66a9-4dbd-86cd-a110c11486d7:3310:1873884700821504:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:1.0:1787076014.544602:0:13229:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787076014.544609:0:13229:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f1d1 00000020:00000080:1.0:1787076014.544613:0:13229:0:(genops.c:906:class_export_put()) final put ffff9961b00b1000/f837e7e9-66a9-4dbd-86cd-a110c11486d7 00000020:01000000:1.0:1787076014.544619:0:13229:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.150@tcp (flags='') 00000020:00000080:1.0:1787076014.544624:0:13229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787076014.544629:0:13229:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.150@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787076014.544633:0:13229:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9961b009b380) has no exports 10000000:01000000:2.0:1787076014.544717:0:5849:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787076014.544784:0:13229:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.150@tcp: client import never connected 00000100:00080000:1.0:1787076014.544787:0:13229:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787076014.544789:0:13229:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787076014.544791:0:13229:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787076014.544793:0:13229:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787076014.544823:0:13229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787076014.544827:0:13229:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.150@tcp (uuid f837e7e9-66a9-4dbd-86cd-a110c11486d7) 00000020:01000000:1.0:1787076014.544831:0:13229:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787076014.544840:0:13229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787076014.544843:0:13229:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787076014.544848:0:13229:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9961bfdc8800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787076014.544853:0:13229:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9961b9e00000) has exports, disconnecting them 00000020:00080000:1.0:1787076014.544857:0:13229:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9961bfdc8800), last request at 1787075816 00000020:00000080:1.0:1787076014.544860:0:13229:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f408 00000020:00080000:1.0:1787076014.544871:0:13229:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9961bfdc8800): rc 0 00000020:00000080:1.0:1787076014.544875:0:13229:0:(genops.c:906:class_export_put()) final put ffff9961bfdc8800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787076014.545827:0:12638:0:(genops.c:865:class_export_destroy()) destroying export ffff9961c180d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787076014.545845:0:12638:0:(genops.c:865:class_export_destroy()) destroying export ffff9961b00b1000/f837e7e9-66a9-4dbd-86cd-a110c11486d7 for MGC192.168.204.150@tcp 00000020:00000080:0.0:1787076014.545851:0:12638:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961918af000 for MGC192.168.204.150@tcp 00000020:00000080:0.0:1787076014.545856:0:12638:0:(genops.c:906:class_export_put()) final put ffff9961918ab800/f837e7e9-66a9-4dbd-86cd-a110c11486d7 00000020:00000080:0.0:1787076014.545859:0:12638:0:(genops.c:865:class_export_destroy()) destroying export ffff9961918ab800/f837e7e9-66a9-4dbd-86cd-a110c11486d7 for MGC192.168.204.150@tcp 00000020:01000000:0.0:1787076014.545863:0:12638:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.150@tcp (f837e7e9-66a9-4dbd-86cd-a110c11486d7) 00000020:00000080:0.0:1787076014.546240:0:12638:0:(genops.c:865:class_export_destroy()) destroying export ffff9961bfdc8800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787076014.546707:0:13229:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787076014.546719:0:13229:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787076014.546722:0:13229:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787076014.546727:0:13229:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787076014.546821:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1787076014.546919:0:12638:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9961c1999800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1787076014.547073:0:12926:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787076014.547284:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787076014.547446:0:5834:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff996189420000:5834] 0 exiting: rc = 1 00000100:00100000:2.0:1787076014.547499:0:5835:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff996189420600:5835] 1 exiting: rc = 0 00000100:00100000:0.0:1787076014.547601:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.547958:0:8465:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff996191973200:8465] 3 exiting: rc = 0 00000100:00100000:2.0:1787076014.548071:0:5837:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99618b865000:5837] 1 exiting: rc = 0 00000100:00100000:2.0:1787076014.548125:0:5838:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9961831f1e00:5838] 2 exiting: rc = 0 00000100:00100000:1.0:1787076014.558378:0:5836:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff996189420e00:5836] 0 exiting: rc = 1 00000100:00100000:0.0:1787076014.558543:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558552:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558558:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558563:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558572:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558578:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558584:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558590:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558596:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558602:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558608:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558613:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558619:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558625:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558632:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558666:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558675:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558682:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558687:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558692:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558697:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558702:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558707:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558712:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558717:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558722:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558727:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558732:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558736:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558754:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558758:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558762:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558768:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558773:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558777:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558783:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558907:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558915:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558921:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558925:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558930:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558936:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558941:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558947:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558952:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558958:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558963:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558968:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558974:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558981:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558986:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.558992:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.559008:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.559096:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.559102:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.559107:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.559113:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.559118:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.559123:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.559129:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.559133:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.559139:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.559143:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.559148:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787076014.560224:0:13229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787076014.560237:0:13229:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787076014.560243:0:13229:0:(genops.c:906:class_export_put()) final put ffff9961bf064000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787076014.560249:0:13229:0:(genops.c:865:class_export_destroy()) destroying export ffff9961bf064000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787076014.560254:0:13229:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787076014.560304:0:13229:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9961bf681000 1 00000020:00000080:0.0:1787076014.560310:0:13229:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x859911ad6869f3ad 00000020:00000080:0.0:1787076014.560317:0:13229:0:(genops.c:906:class_export_put()) final put ffff9961bf067000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787076014.560335:0:13229:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787076014.560340:0:13229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787076014.560345:0:13229:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787076014.560349:0:13229:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff996191838000) has no exports 00000020:00000080:2.0:1787076014.560434:0:12638:0:(genops.c:865:class_export_destroy()) destroying export ffff9961bf067000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787076014.577192:0:13229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787076014.577221:0:13229:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787076014.577226:0:13229:0:(genops.c:906:class_export_put()) final put ffff9961bf681800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787076014.577231:0:13229:0:(genops.c:865:class_export_destroy()) destroying export ffff9961bf681800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787076014.577242:0:13229:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787076014.577440:0:13229:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9961bf686800 00000020:01000000:1.0:1787076014.577468:0:13229:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787076014.577472:0:13229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787076014.577476:0:13229:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787076014.577481:0:13229:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9961b9e019c0) has no exports 00000020:00000080:1.0:1787076014.577509:0:13229:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787076014.577517:0:13229:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787076014.577521:0:13229:0:(genops.c:906:class_export_put()) final put ffff9961baee7000/OSS_uuid 00000020:00000080:1.0:1787076014.577523:0:13229:0:(genops.c:865:class_export_destroy()) destroying export ffff9961baee7000/OSS_uuid for OSS 00000020:01000000:1.0:1787076014.577527:0:13229:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1787076014.580380:0:8477:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff99618300b400:8477] 3 exiting: rc = 0 00000100:00100000:0.0:1787076014.580498:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9961910e2200:6704] 0 exiting: rc = 1 00000100:00100000:1.0:1787076014.580590:0:12484:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9961b9258600:12484] 4 exiting: rc = 0 00000100:00100000:1.0:1787076014.580685:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9961877b0c00:6705] 1 exiting: rc = 0 00000100:00080000:2.0:1787076014.580909:0:5848:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787076014.581174:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff99618302aa00:6706] 2 exiting: rc = 0 00000100:00100000:0.0:1787076014.581513:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.581522:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.581530:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.581537:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.581542:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.581547:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.581553:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.581558:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.581576:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.581583:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.581589:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.581593:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.581600:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.581605:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.581611:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.581617:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.581623:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.581629:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.581634:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582002:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582139:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582150:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582156:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582162:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582168:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582174:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582179:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582184:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582190:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582195:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582276:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582284:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582290:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582296:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582302:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582306:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582312:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582318:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582323:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582329:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582335:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582341:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582346:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582351:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582357:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582362:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582367:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582372:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582378:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582382:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582387:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582392:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582397:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582402:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582416:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582422:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582430:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582436:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582441:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582446:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582451:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582457:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582465:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.582475:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787076014.583781:0:9220:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff99619112b600:9220] 2 exiting: rc = 0 00000100:00100000:2.0:1787076014.584235:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9961b5107e00:6707] 0 exiting: rc = 1 00000100:00100000:3.0:1787076014.584406:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff996187d56600:6708] 1 exiting: rc = 0 00000100:00100000:0.0:1787076014.584585:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584594:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584600:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584606:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584612:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584618:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584624:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584630:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584636:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584890:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584896:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584901:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584906:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584912:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584918:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584923:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584929:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584935:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584941:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584946:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584952:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584957:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584962:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584968:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584973:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.584995:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585151:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585157:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585163:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585168:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585172:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585177:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585181:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585186:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585191:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585196:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585271:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585278:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585284:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585289:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585295:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585301:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585306:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585312:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585317:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585323:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585328:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585334:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585343:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585348:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585354:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585363:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585369:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585375:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585380:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585386:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585391:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585396:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585401:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585407:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585422:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585427:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585433:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.585439:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787076014.587626:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9961b5107a00:6710] 1 exiting: rc = 0 00000100:00100000:3.0:1787076014.587927:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9961b5106800:6709] 0 exiting: rc = 1 00000100:00100000:2.0:1787076014.588580:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9961b5107800:6711] 2 exiting: rc = 0 00000100:00100000:0.0:1787076014.588911:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.588921:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.588931:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.588936:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.588941:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.588947:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.588952:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.588957:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.588963:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.588969:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.588974:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.588979:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.588985:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589197:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589271:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589277:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589283:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589289:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589294:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589301:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589307:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589313:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589318:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589324:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589330:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589351:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589359:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589364:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589370:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589375:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589380:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589398:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589403:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589409:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589414:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589419:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589425:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589431:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589437:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589443:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589449:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589454:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589461:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589467:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589473:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589478:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589484:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589490:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589496:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589517:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589525:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589531:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589537:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589543:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589547:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589552:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589558:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589566:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589572:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589577:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589582:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589587:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589592:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.589597:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787076014.599095:0:6713:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9961bbab3c00:6713] 1 exiting: rc = 0 00000100:00100000:0.0:1787076014.599926:0:6712:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9961b97f5400:6712] 0 exiting: rc = 1 00000100:00100000:3.0:1787076014.600067:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600076:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600082:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600087:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600092:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600097:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600101:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600107:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600112:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600117:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600123:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600127:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600132:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600138:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600143:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600156:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600161:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600166:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600170:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600175:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600181:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600186:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600191:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600196:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600213:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600218:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600224:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600229:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600235:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600240:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600245:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600250:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600255:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600259:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600264:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600269:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600273:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600278:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600283:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600288:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600293:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600297:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600302:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600307:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600312:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600317:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600322:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600327:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600333:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600338:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600352:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600356:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600362:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600367:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600372:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600376:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600381:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600386:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600390:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600395:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600401:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600406:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600411:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.600416:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601502:0:6714:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9961c1ac4a00:6714] 0 exiting: rc = 1 00000100:00100000:3.0:1787076014.601590:0:6715:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9961c1ac4c00:6715] 1 exiting: rc = 0 00000100:00100000:3.0:1787076014.601682:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601690:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601696:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601702:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601717:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601725:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601731:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601738:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601744:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601750:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601757:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601764:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601770:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601777:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601783:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601871:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601897:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601904:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601912:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601928:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601934:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601940:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601946:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601951:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601957:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601963:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601968:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601974:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.601996:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602004:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602093:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602100:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602107:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602113:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602118:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602124:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602130:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602136:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602142:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602148:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602167:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602175:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602181:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602186:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602192:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602199:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602276:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602282:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602288:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602295:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602302:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602308:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602329:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602338:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602351:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602357:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602363:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602369:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602375:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602380:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602388:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602393:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602399:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787076014.602408:0:13229:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787076014.615099:0:13229:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787076029.867109:0:13843:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787076037.981243:0:14306:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787076037.981249:0:14306:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787076037.981363:0:14306:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9961893b3000 00000020:01000004:3.0:1787076037.981379:0:14306:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787076037.981387:0:14306:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787076037.981403:0:14306:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9961b0098000) 00000020:00000080:3.0:1787076037.986507:0:14306:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787076038.036631:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787076038.044625:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1787076038.044988:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 283: rc = 0 00100000:10000000:0.0:1787076038.045117:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 283: rc = 0 00100000:10000000:0.0:1787076038.049026:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 283: rc = 0 00100000:10000000:0.0:1787076038.052106:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 283: rc = 0 00100000:10000000:0.0:1787076038.052526:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787076038.052624:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 283: rc = 0 00100000:10000000:0.0:1787076038.052756:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 283: rc = 0 00100000:10000000:0.0:1787076038.053027:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 285: rc = 0 00100000:10000000:0.0:1787076038.055949:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 441: rc = 0 00100000:10000000:0.0:1787076038.056203:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 441: rc = 0 00100000:10000000:0.0:1787076038.056819:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 644: rc = 0 00100000:10000000:0.0:1787076038.057212:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:0.0:1787076038.058233:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 644: rc = 0 00100000:10000000:0.0:1787076038.059119:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 644: rc = 0 00100000:10000000:0.0:1787076038.059398:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 644: rc = 0 00100000:10000000:0.0:1787076038.059775:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 644: rc = 0 00100000:10000000:0.0:1787076038.060041:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 644: rc = 0 00100000:10000000:0.0:1787076038.060388:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 644: rc = 0 00100000:10000000:0.0:1787076038.060671:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 644: rc = 0 00100000:10000000:0.0:1787076038.060916:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 644: rc = 0 00100000:10000000:0.0:1787076038.061160:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 644: rc = 0 00100000:10000000:0.0:1787076038.061404:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 644: rc = 0 00100000:10000000:0.0:1787076038.064284:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 777: rc = 0 00100000:10000000:0.0:1787076038.065908:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 777: rc = 0 00100000:10000000:0.0:1787076038.066186:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 777: rc = 0 00100000:10000000:0.0:1787076038.066723:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 777: rc = 0 00100000:10000000:0.0:1787076038.067010:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 777: rc = 0 00100000:10000000:0.0:1787076038.067342:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 777: rc = 0 00100000:10000000:0.0:1787076038.067617:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 777: rc = 0 00100000:10000000:1.0:1787076038.070772:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 777: rc = 0 00100000:10000000:1.0:1787076038.071348:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 777: rc = 0 00100000:10000000:1.0:1787076038.071672:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 777: rc = 0 00100000:10000000:1.0:1787076038.072153:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 777: rc = 0 00100000:10000000:1.0:1787076038.074310:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 777: rc = 0 00100000:10000000:1.0:1787076038.074672:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 777: rc = 0 00100000:10000000:1.0:1787076038.074925:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 777: rc = 0 00100000:10000000:1.0:1787076038.075799:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 777: rc = 0 00100000:10000000:1.0:1787076038.076206:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 777: rc = 0 00100000:10000000:1.0:1787076038.076528:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 777: rc = 0 00100000:10000000:1.0:1787076038.076830:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 777: rc = 0 00100000:10000000:1.0:1787076038.078994:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 777: rc = 0 00100000:10000000:1.0:1787076038.080845:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 777: rc = 0 00100000:10000000:1.0:1787076038.081141:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 777: rc = 0 00100000:10000000:1.0:1787076038.081396:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 777: rc = 0 00100000:10000000:1.0:1787076038.081770:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 777: rc = 0 00100000:10000000:1.0:1787076038.082178:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 777: rc = 0 00100000:10000000:1.0:1787076038.082424:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 777: rc = 0 00100000:10000000:1.0:1787076038.084076:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 777: rc = 0 00100000:10000000:1.0:1787076038.086209:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 777: rc = 0 00100000:10000000:1.0:1787076038.086704:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 777: rc = 0 00100000:10000000:1.0:1787076038.087454:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 777: rc = 0 00100000:10000000:1.0:1787076038.088634:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 777: rc = 0 00100000:10000000:1.0:1787076038.089147:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 777: rc = 0 00100000:10000000:1.0:1787076038.089634:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 777: rc = 0 00100000:10000000:1.0:1787076038.090294:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 551: rc = 0 00100000:10000000:1.0:1787076038.090929:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1787076038.091858:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 442: rc = 0 00100000:10000000:1.0:1787076038.092109:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1787076038.092180:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 442: rc = 0 00100000:10000000:1.0:1787076038.092383:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1787076038.092453:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 442: rc = 0 00100000:10000000:1.0:1787076038.092865:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1787076038.092932:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 446: rc = 0 00100000:10000000:1.0:1787076038.093128:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1787076038.093193:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 446: rc = 0 00100000:10000000:1.0:1787076038.093869:0:14306:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1787076038.094117:0:14306:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 446: rc = 0 00000020:00000080:1.0:1787076038.094386:0:14306:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787076038.094394:0:14306:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787076038.094405:0:14306:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x859911ad686a04d2 00000020:01000004:1.0:1787076038.094413:0:14306:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787076038.094418:0:14306:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787076038.094424:0:14306:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9961893b3000 from MGS 00000020:01000004:1.0:1787076038.094427:0:14306:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787076038.094437:0:14306:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9961c1800000) 00000020:00000080:1.0:1787076038.094447:0:14306:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787076038.094499:0:14306:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9961893b3000 from MGS, refs=2 00080000:01000000:1.0:1787076038.094504:0:14306:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787076038.094508:0:14306:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x859911ad686a04e0 00000100:00100000:1.0:1787076038.094612:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787076038.094834:0:14306:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787076038.094840:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787076038.095437:0:14306:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787076038.095445:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787076038.097062:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787076038.097318:0:14306:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787076038.097324:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787076038.098133:0:14306:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787076038.098140:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787076038.098556:0:14306:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787076038.098563:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787076038.099636:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076038.099655:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076038.099657:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076038.100267:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076038.100277:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076038.100279:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076038.100834:0:14306:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787076038.107046:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787076038.115455:0:14306:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787076038.115475:0:14306:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787076038.115478:0:14306:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787076038.117136:0:14315:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787076038.117333:0:14306:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787076038.117433:0:14306:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787076038.118121:0:14306:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787076038.119137:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787076038.119385:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787076038.119392:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787076038.121287:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787076038.121299:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787076038.122375:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787076038.122384:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787076038.126252:0:14306:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787076038.126277:0:14306:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.150@tcp' 00000020:01000004:1.0:1787076038.126279:0:14306:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787076038.126311:0:14306:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.150@tcp (typ=mgc) 00000020:00000080:1.0:1787076038.126395:0:14306:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.150@tcp (ffff9961c1804d40) 00000020:00000080:1.0:1787076038.126414:0:14306:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787076038.126492:0:14306:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9961bf064000@MGC192.168.204.150@tcp: add connection 192.168.204.150@tcp at head 00000100:00080000:3.0:1787076038.126565:0:14320:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:1.0:1787076038.126908:0:14306:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.150@tcp-0 is initialized 00000040:01000000:1.0:1787076038.126992:0:14306:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787076038.127445:0:14321:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787076038.127511:0:14306:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.150@tcp (uuid 51646941-6761-4bd4-bf4b-97125ced6c1b) 00000020:00000080:3.0:1787076038.127527:0:14306:0:(genops.c:1406:class_connect()) connect: client 51646941-6761-4bd4-bf4b-97125ced6c1b, cookie 0x859911ad686a04ee 00000100:00080000:3.0:1787076038.127543:0:14306:0:(import.c:510:import_select_connection()) MGC192.168.204.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787076038.127549:0:14306:0:(import.c:624:import_select_connection()) MGC192.168.204.150@tcp: import ffff9961bf064000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1787076038.127580:0:14306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9961c1845500 x1873884700821760/t0(0) o250->MGC192.168.204.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787076038.127621:0:14306:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 51646941-6761-4bd4-bf4b-97125ced6c1b->MGS 00000100:00100000:2.0:1787076038.127663:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:51646941-6761-4bd4-bf4b-97125ced6c1b:3310:1873884700821760:0@lo:250:mount.lustre.0 00000020:01000004:3.0:1787076038.127664:0:14306:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787076038.127669:0:14306:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787076038.127679:0:14306:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9961b009b380) 00000020:00000080:3.0:1787076038.127688:0:14306:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787076038.127731:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076038.127880:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700821760 00000100:00100000:2.0:1787076038.127889:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700821760 00000100:00100000:2.0:1787076038.127925:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787076038.127933:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bbacc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1873884700821760:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787076038.127955:0:14316:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 51646941-6761-4bd4-bf4b-97125ced6c1b@0@lo t0 exp 0000000000000000 cur 420 last 0 00000020:00000080:2.0:1787076038.127977:0:14316:0:(genops.c:1406:class_connect()) connect: client 51646941-6761-4bd4-bf4b-97125ced6c1b, cookie 0x859911ad686a04fc 00000100:00080000:2.0:1787076038.128161:0:14316:0:(import.c:65:import_set_state_nolock()) ffff996187581000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787076038.128290:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bbacc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+5:3310:x1873884700821760:12345-0@lo:250:mount.lustre.0 Request processed in 356us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076038.128298:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787076038.128341:0:3310:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787076038.128356:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.150@tcp: connect to target with instance 0 00000100:00080000:2.0:1787076038.128362:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787076038.128366:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787076038.128369:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961bf064000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787076038.128372:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787076038.128386:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787076038.128392:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:51646941-6761-4bd4-bf4b-97125ced6c1b:3310:1873884700821760:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787076038.143367:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787076038.143606:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787076038.143614:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787076038.144367:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787076038.144375:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787076038.145019:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787076038.145027:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787076038.146064:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787076038.146251:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787076038.146256:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787076038.146856:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787076038.146862:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787076038.185608:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787076038.186157:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787076038.186165:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787076038.187440:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787076038.187452:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787076038.188211:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787076038.188383:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787076038.188389:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787076038.191772:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787076038.191788:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787076038.192968:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787076038.193155:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787076038.193161:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787076038.194201:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787076038.194210:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787076038.195180:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787076038.195356:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787076038.195361:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787076038.196201:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787076038.196209:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787076038.217405:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787076038.217619:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787076038.217625:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787076038.219386:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787076038.219397:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787076038.220977:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787076038.220988:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787076038.222268:0:14306:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787076038.222295:0:14306:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787076038.222301:0:14306:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787076038.222439:0:14306:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787076038.222478:0:14306:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.150@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787076038.222483:0:14306:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787076038.222485:0:14306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787076038.222486:0:14306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787076038.222487:0:14306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787076038.222489:0:14306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787076038.222490:0:14306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787076038.222491:0:14306:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787076038.222493:0:14306:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787076038.222495:0:14306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787076038.222496:0:14306:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787076038.222499:0:14306:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787076038.222501:0:14306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787076038.222502:0:14306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787076038.222504:0:14306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787076038.222505:0:14306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787076038.222506:0:14306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787076038.222506:0:14306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787076038.222507:0:14306:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787076038.222508:0:14306:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787076038.222510:0:14306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787076038.222511:0:14306:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787076038.222539:0:14306:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787076038.222558:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1847480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700821888:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787076038.222966:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076038.223031:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffff996194347240 going to sleep for 11 seconds 00000100:00100000:1.0:1787076038.223053:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700821888 00000100:00100000:1.0:1787076038.223060:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700821888 00000100:00100000:1.0:1787076038.223148:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787076038.223158:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bab97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+5:14306:x1873884700821888:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787076038.223206:0:14318:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787076038.223210:0:14318:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787076038.223213:0:14318:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787076038.224500:0:14339:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787076038.225347:0:14318:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1787076038.227417:0:14340:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787076038.227438:0:14340:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787076038.227441:0:14340:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787076038.227477:0:14340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787076038.227806:0:14318:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787076038.227820:0:14318:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787076038.236396:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bab97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+5:14306:x1873884700821888:12345-0@lo:253:mount.lustre.0 Request processed in 13230us (13421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076038.236415:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787076038.236531:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1847480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700821888:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787076038.236549:0:14306:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787076038.236552:0:14306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787076038.236554:0:14306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787076038.236556:0:14306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787076038.236557:0:14306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787076038.236558:0:14306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787076038.236560:0:14306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787076038.236562:0:14306:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787076038.236563:0:14306:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787076038.236565:0:14306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787076038.236566:0:14306:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787076038.236587:0:14306:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9961893b3000 from lustre-MDT0000 10000000:01000000:0.0:1787076038.236624:0:14306:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787076038.236628:0:14306:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787076038.236632:0:14306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9961c1804d40 10000000:01000000:0.0:1787076038.236636:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787076038.236684:0:14306:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9961c1804d40 from 1 10000000:01000000:0.0:1787076038.236687:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787076038.236729:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe68200/0x859911ad686a0503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076038.236852:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9961bfe68200/0x859911ad686a0503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076038.236863:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9961bfe68200/0x859911ad686a0503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076038.236885:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700822016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787076038.237247:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076038.237293:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b5293a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787076038.237363:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700822016 00000100:00100000:1.0:1787076038.237377:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700822016 00000100:00100000:1.0:1787076038.237419:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787076038.237428:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bab97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+6:14306:x1873884700822016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787076038.237453:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787076038.237473:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961bf633600/0x859911ad686a050a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a0503 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.237511:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961bf633600/0x859911ad686a050a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a0503 expref: 7 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.237522:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961bf633600/0x859911ad686a050a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a0503 expref: 7 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.237531:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf633600, rc 0) 00000100:00100000:1.0:1787076038.237572:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bab97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+7:14306:x1873884700822016:12345-0@lo:101:mount.lustre.0 Request processed in 146us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076038.237580:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787076038.238179:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700822016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787076038.238196:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9961bfe68200/0x859911ad686a0503 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a050a expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076038.238206:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9961bfe68200/0x859911ad686a0503 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a050a expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076038.238266:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700822144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787076038.238299:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076038.238329:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b5293a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787076038.238379:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700822144 00000100:00100000:1.0:1787076038.238384:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700822144 00000100:00100000:1.0:1787076038.238405:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787076038.238412:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bab95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+7:14306:x1873884700822144:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787076038.238684:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bab95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+7:14306:x1873884700822144:12345-0@lo:501:mount.lustre.0 Request processed in 271us (383us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787076038.238691:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787076038.238866:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700822144:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787076038.238904:0:14306:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787076038.239034:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe68200/0x859911ad686a0503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a050a expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076038.239054:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961bfe68200/0x859911ad686a0503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a050a expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787076038.239063:0:14306:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9961893b3000 10000000:01000000:0.0:1787076038.239068:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787076038.239072:0:14306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9961893b3000 10000000:01000000:0.0:1787076038.239075:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787076038.239078:0:14306:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9961893b3000 from 1 10000000:01000000:0.0:1787076038.239081:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787076038.239105:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe68800/0x859911ad686a0511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076038.239111:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9961bfe68800/0x859911ad686a0511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076038.239120:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9961bfe68800/0x859911ad686a0511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076038.239133:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700822272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787076038.239160:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076038.239181:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b5293a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787076038.239274:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700822272 00000100:00100000:3.0:1787076038.239281:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700822272 00000100:00100000:3.0:1787076038.239303:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787076038.239310:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bab96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+6:14306:x1873884700822272:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787076038.239328:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787076038.239341:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181523a00/0x859911ad686a0518 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a0511 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076038.239361:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181523a00/0x859911ad686a0518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a0511 expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076038.239370:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181523a00/0x859911ad686a0518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a0511 expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076038.239378:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523a00, rc 0) 00000100:00100000:3.0:1787076038.239583:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bab96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+7:14306:x1873884700822272:12345-0@lo:101:mount.lustre.0 Request processed in 272us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076038.239590:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787076038.239891:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700822272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787076038.240149:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9961bfe68800/0x859911ad686a0511 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0518 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076038.240158:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9961bfe68800/0x859911ad686a0511 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a0518 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787076038.240187:0:14306:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787076038.240239:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe68800/0x859911ad686a0511 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0518 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076038.240247:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961bfe68800/0x859911ad686a0511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0518 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787076038.240253:0:14306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787076038.240258:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787076038.240263:0:14306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9961893b3000 10000000:01000000:0.0:1787076038.240265:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787076038.240269:0:14306:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787076038.240271:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787076038.240291:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe69e00/0x859911ad686a051f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076038.240297:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9961bfe69e00/0x859911ad686a051f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076038.240305:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9961bfe69e00/0x859911ad686a051f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076038.240321:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700822400:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787076038.240355:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076038.240386:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b5293a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787076038.240502:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700822400 00000100:00100000:2.0:1787076038.240508:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700822400 00000100:00100000:2.0:1787076038.240590:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787076038.240619:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bab94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+7:14306:x1873884700822400:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787076038.240628:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787076038.240654:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961c1841200/0x859911ad686a0526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a051f expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076038.240673:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961c1841200/0x859911ad686a0526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a051f expref: 8 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076038.240682:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961c1841200/0x859911ad686a0526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a051f expref: 8 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076038.240688:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1841200, rc 0) 00000100:00100000:2.0:1787076038.240730:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bab94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+8:14306:x1873884700822400:12345-0@lo:101:mount.lustre.0 Request processed in 115us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076038.240745:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787076038.240817:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700822400:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787076038.240827:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9961bfe69e00/0x859911ad686a051f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0526 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076038.240841:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9961bfe69e00/0x859911ad686a051f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a0526 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076038.240887:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700822528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787076038.240930:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076038.241314:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b5293a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787076038.241382:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700822528 00000100:00100000:3.0:1787076038.241388:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700822528 00000100:00100000:3.0:1787076038.241412:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787076038.241419:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bab95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+8:14306:x1873884700822528:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787076038.242109:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bab95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+9:14306:x1873884700822528:12345-0@lo:501:mount.lustre.0 Request processed in 688us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076038.242117:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787076038.242216:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700822528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787076038.242271:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700822656:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787076038.242311:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076038.242341:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b5293a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787076038.242397:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700822656 00000100:00100000:3.0:1787076038.242402:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700822656 00000100:00100000:3.0:1787076038.242485:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787076038.242496:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bab97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+9:14306:x1873884700822656:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787076038.243078:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bab97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+9:14306:x1873884700822656:12345-0@lo:503:mount.lustre.0 Request processed in 583us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076038.243097:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787076038.243584:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700822656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787076038.244369:0:14341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51646941-6761-4bd4-bf4b-97125ced6c1b:14341:1873884700822784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787076038.244520:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076038.244606:0:14341:0:(client.c:2702:ptlrpc_set_wait()) set ffff996185da8180 going to sleep for 11 seconds 00000100:00100000:3.0:1787076038.245326:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700822784 00000100:00100000:3.0:1787076038.245334:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700822784 00000100:00100000:3.0:1787076038.245471:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787076038.245481:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+9:14341:x1873884700822784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787076038.246223:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+9:14341:x1873884700822784:12345-0@lo:502:llog_process_th.0 Request processed in 741us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076038.246231:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787076038.246311:0:14341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51646941-6761-4bd4-bf4b-97125ced6c1b:14341:1873884700822784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787076038.246342:0:14341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787076038.246353:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787076038.246356:0:14341:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787076038.246362:0:14341:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787076038.246365:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787076038.246380:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99619183b380) 00000020:00000080:2.0:1787076038.246397:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787076038.246401:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787076038.246542:0:14341:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787076038.246548:0:14341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x859911ad686a0534 00000020:00000080:2.0:1787076038.247191:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787076038.247197:0:14341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787076038.247201:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787076038.247203:0:14341:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787076038.247206:0:14341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787076038.247210:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787076038.247212:0:14341:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787076038.247215:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787076038.247225:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff996191838000) 00000020:00000080:2.0:1787076038.247235:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787076038.247240:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787076038.247242:0:14341:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787076038.247245:0:14341:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787076038.247251:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787076038.247294:0:14341:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9961893b3000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787076038.247308:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9961918399c0) 00000020:00000080:2.0:1787076038.247318:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787076038.247372:0:14341:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787076038.247384:0:14341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x859911ad686a0549 00000020:00000080:2.0:1787076038.247555:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787076038.247561:0:14341:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787076038.247566:0:14341:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x859911ad686a0550 00080000:01000000:2.0:1787076038.247571:0:14341:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787076038.247577:0:14341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x859911ad686a0557 00010000:00010000:0.0:1787076038.344242:0:14341:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1787076038.350109:0:14341:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:0.0:1787076038.350334:0:14341:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787076038.353259:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9961b9e019c0) 00000020:00000080:0.0:1787076038.353287:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787076038.355100:0:14341:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787076038.355117:0:14341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x859911ad686a0565 00000020:00000080:1.0:1787076038.357676:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787076038.373229:0:14341:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x859911ad686a056c 00000020:00000080:0.0:1787076038.374144:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787076038.374158:0:14341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787076038.374166:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076038.374168:0:14341:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787076038.374172:0:14341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787076038.374180:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076038.374181:0:14341:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787076038.374186:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787076038.374236:0:14341:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787076038.374251:0:14341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787076038.374253:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076038.374254:0:14341:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787076038.374257:0:14341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787076038.374258:0:14341:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1787076038.374260:0:14341:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787076038.374261:0:14341:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787076038.374263:0:14341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787076038.374265:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076038.374266:0:14341:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787076038.374268:0:14341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787076038.374271:0:14341:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787076038.374274:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076038.374276:0:14341:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787076038.374279:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787076038.374284:0:14341:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.150@tcp to nid 0x20000c0a8cc96 (192.168.204.150@tcp) 00000020:01000000:0.0:1787076038.374308:0:14341:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787076038.374311:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787076038.374326:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9961b9e00000) 00000020:00000080:0.0:1787076038.374342:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787076038.374346:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787076038.374409:0:14341:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787076038.374414:0:14341:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787076038.374421:0:14341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x859911ad686a057a 00010000:00080000:0.0:1787076038.374450:0:14341:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9961b00b2000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.150@tcp at head 00010000:00010000:0.0:1787076038.374740:0:14341:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1787076038.375371:0:14341:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787076038.375722:0:14341:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787076038.377279:0:14341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787076038.377340:0:14341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787076038.378100:0:14341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787076038.380079:0:14345:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787076038.380085:0:14345:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787076038.385159:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787076038.385174:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787076038.385227:0:14341:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787076038.385247:0:14341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x859911ad686a0581 00000100:00080000:1.0:1787076038.385257:0:14341:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787076038.385263:0:14341:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9961b00b2000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:1.0:1787076038.385298:0:14341:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9961b52e6680 x1873884700822912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787076038.385324:0:14341:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1787076038.385361:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700822912:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1787076038.385387:0:14341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787076038.385391:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787076038.385393:0:14341:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787076038.385396:0:14341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787076038.385399:0:14341:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1787076038.385401:0:14341:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787076038.385402:0:14341:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787076038.385404:0:14341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787076038.385407:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787076038.385409:0:14341:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787076038.385411:0:14341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787076038.385415:0:14341:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787076038.385418:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787076038.385420:0:14341:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787076038.385423:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787076038.385426:0:14341:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.150@tcp to nid 0x20000c0a8cc96 (192.168.204.150@tcp) 00000020:01000000:1.0:1787076038.385449:0:14341:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787076038.385452:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787076038.385464:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9961c1803380) 00000020:00000080:1.0:1787076038.385474:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787076038.385479:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787076038.385532:0:14341:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787076038.385538:0:14341:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787076038.385543:0:14341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x859911ad686a058f 00010000:00080000:1.0:1787076038.385571:0:14341:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9961bf061800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.150@tcp at head 00000400:00000100:2.0:1787076038.385622:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873884700822912 offset 0 length 520: 4 00010000:00010000:1.0:1787076038.385805:0:14341:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787076038.385997:0:14341:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787076038.386019:0:14341:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787076038.386800:0:14341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787076038.386869:0:14341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787076038.386937:0:14341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787076038.394314:0:14347:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787076038.394323:0:14347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787076038.395319:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787076038.395330:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787076038.395360:0:14341:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787076038.395378:0:14341:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x859911ad686a0596 00000100:00080000:0.0:1787076038.395387:0:14341:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787076038.395393:0:14341:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9961bf061800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:0.0:1787076038.395429:0:14341:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996184e8d180 x1873884700823040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787076038.395493:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700823040:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787076038.395547:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873884700823040 offset 0 length 520: 4 00000100:00080000:0.0:1787076038.395610:0:14341:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787076038.395680:0:14341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787076038.395684:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076038.395686:0:14341:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787076038.395688:0:14341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787076038.395692:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076038.395694:0:14341:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787076038.395696:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787076038.395698:0:14341:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787076038.395700:0:14341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787076038.395702:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076038.395703:0:14341:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787076038.395705:0:14341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787076038.395707:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076038.395709:0:14341:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787076038.395712:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787076038.395737:0:14341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51646941-6761-4bd4-bf4b-97125ced6c1b:14341:1873884700823168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787076038.395785:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076038.395803:0:14341:0:(client.c:2702:ptlrpc_set_wait()) set ffff996187998240 going to sleep for 11 seconds 00000100:00100000:1.0:1787076038.395940:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700823168 00000100:00100000:1.0:1787076038.395947:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700823168 00000100:00100000:1.0:1787076038.395994:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787076038.396004:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+9:14341:x1873884700823168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787076038.396237:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+9:14341:x1873884700823168:12345-0@lo:502:llog_process_th.0 Request processed in 234us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076038.396245:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787076038.397723:0:14341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51646941-6761-4bd4-bf4b-97125ced6c1b:14341:1873884700823168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787076038.397874:0:14341:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787076038.397885:0:14341:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076038.397896:0:14341:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787076038.397901:0:14341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787076038.398222:0:14306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1787076038.398245:0:14306:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787076038.398268:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe69e00/0x859911ad686a051f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0526 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076038.398279:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961bfe69e00/0x859911ad686a051f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0526 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787076038.398286:0:14306:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9961893b3000 from 1 10000000:01000000:3.0:1787076038.398290:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787076038.398325:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad686a059d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076038.398333:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad686a059d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076038.398355:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad686a059d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076038.398375:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700823296:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787076038.398917:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076038.399059:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1780 going to sleep for 11 seconds 00000100:00100000:2.0:1787076038.399123:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700823296 00000100:00100000:2.0:1787076038.399131:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700823296 00000100:00100000:2.0:1787076038.399217:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787076038.399227:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+9:14306:x1873884700823296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787076038.399241:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787076038.399257:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961c1840400/0x859911ad686a05a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a059d expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076038.399279:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961c1840400/0x859911ad686a05a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a059d expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076038.399290:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961c1840400/0x859911ad686a05a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a059d expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076038.399299:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1840400, rc 0) 00000100:00100000:2.0:1787076038.399348:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+10:14306:x1873884700823296:12345-0@lo:101:mount.lustre.0 Request processed in 122us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076038.399355:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787076038.399451:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700823296:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787076038.399464:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad686a059d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a05a4 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076038.399473:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad686a059d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a05a4 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076038.400264:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700823424:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787076038.400310:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076038.400756:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1780 going to sleep for 11 seconds 00000100:00100000:1.0:1787076038.401020:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700823424 00000100:00100000:1.0:1787076038.401028:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700823424 00000100:00100000:1.0:1787076038.401066:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787076038.401075:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+10:14306:x1873884700823424:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787076038.401092:0:14317:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787076038.401099:0:14317:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787076038.401182:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+10:14306:x1873884700823424:12345-0@lo:256:mount.lustre.0 Request processed in 108us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076038.401191:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787076038.401291:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700823424:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787076038.402197:0:14306:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787076038.402220:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad686a059d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a05a4 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076038.402232:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad686a059d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a05a4 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787076038.402240:0:14306:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9961893b3000 from 1 10000000:01000000:3.0:1787076038.402243:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787076038.402284:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad686a05ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076038.402291:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad686a05ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076038.402300:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad686a05ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076038.402316:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700823552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787076038.402359:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076038.402397:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1780 going to sleep for 11 seconds 00000100:00100000:1.0:1787076038.402473:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700823552 00000100:00100000:1.0:1787076038.402479:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700823552 00000100:00100000:1.0:1787076038.402519:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787076038.402526:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baeddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+10:14306:x1873884700823552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787076038.402535:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787076038.402548:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961bf633c00/0x859911ad686a05b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a05ab expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.402574:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961bf633c00/0x859911ad686a05b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a05ab expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.402582:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961bf633c00/0x859911ad686a05b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a05ab expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.402600:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf633c00, rc 0) 00000100:00100000:1.0:1787076038.402673:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baeddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+11:14306:x1873884700823552:12345-0@lo:101:mount.lustre.0 Request processed in 115us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076038.402680:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787076038.402900:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700823552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787076038.402922:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad686a05ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a05b2 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076038.403042:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad686a05ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a05b2 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076038.403092:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700823680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787076038.403119:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076038.403148:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1780 going to sleep for 11 seconds 00000100:00100000:1.0:1787076038.403203:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700823680 00000100:00100000:1.0:1787076038.403208:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700823680 00000100:00100000:1.0:1787076038.403226:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787076038.403232:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+11:14306:x1873884700823680:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787076038.403704:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+11:14306:x1873884700823680:12345-0@lo:501:mount.lustre.0 Request processed in 470us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076038.403712:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787076038.403941:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700823680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787076038.403977:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700823808:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787076038.404014:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076038.404041:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1780 going to sleep for 11 seconds 00000100:00100000:1.0:1787076038.404186:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700823808 00000100:00100000:1.0:1787076038.404192:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700823808 00000100:00100000:1.0:1787076038.404212:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787076038.404218:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+11:14306:x1873884700823808:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787076038.404357:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+11:14306:x1873884700823808:12345-0@lo:503:mount.lustre.0 Request processed in 139us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076038.404364:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787076038.404599:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700823808:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787076038.405756:0:14349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51646941-6761-4bd4-bf4b-97125ced6c1b:14349:1873884700823936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787076038.405887:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076038.405932:0:14349:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618954b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787076038.406780:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700823936 00000100:00100000:2.0:1787076038.406791:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700823936 00000100:00100000:2.0:1787076038.406907:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787076038.406918:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+11:14349:x1873884700823936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787076038.407213:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+11:14349:x1873884700823936:12345-0@lo:502:llog_process_th.0 Request processed in 297us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076038.407221:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787076038.407266:0:14349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51646941-6761-4bd4-bf4b-97125ced6c1b:14349:1873884700823936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787076038.407298:0:14349:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787076038.407307:0:14349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076038.407310:0:14349:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787076038.407316:0:14349:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9961893b3000 00000020:00000080:0.0:1787076038.407319:0:14349:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787076038.407326:0:14349:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787076038.407329:0:14349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076038.407330:0:14349:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787076038.407332:0:14349:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787076038.407334:0:14349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076038.407335:0:14349:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787076038.407338:0:14349:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9961893b3000 00000020:00000080:0.0:1787076038.407340:0:14349:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787076038.407474:0:14349:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787076038.407480:0:14349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076038.407481:0:14349:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787076038.407484:0:14349:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787076038.407486:0:14349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076038.407488:0:14349:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787076038.407491:0:14349:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9961893b3000 00000020:00000080:0.0:1787076038.407493:0:14349:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787076038.407549:0:14349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51646941-6761-4bd4-bf4b-97125ced6c1b:14349:1873884700824064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787076038.407588:0:14349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076038.407630:0:14349:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618954b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787076038.407654:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700824064 00000100:00100000:3.0:1787076038.407659:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700824064 00000100:00100000:3.0:1787076038.407693:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787076038.407701:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+11:14349:x1873884700824064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787076038.408036:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+11:14349:x1873884700824064:12345-0@lo:502:llog_process_th.0 Request processed in 335us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076038.408042:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787076038.408485:0:14349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51646941-6761-4bd4-bf4b-97125ced6c1b:14349:1873884700824064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787076038.408583:0:14349:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787076038.408589:0:14349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076038.408600:0:14349:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787076038.408604:0:14349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787076038.408869:0:14306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787076038.408888:0:14306:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787076038.408966:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad686a05ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a05b2 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076038.408978:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad686a05ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a05b2 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787076038.409026:0:14306:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787076038.409029:0:14306:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9961893b3000 10000000:01000000:3.0:1787076038.409031:0:14306:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9961893b3000 10000000:01000000:3.0:1787076038.409035:0:14306:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787076038.409041:0:14306:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9961893b3000 from 1 10000000:01000000:3.0:1787076038.409043:0:14306:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787076038.409072:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181523e00/0x859911ad686a05b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076038.409080:0:14306:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996181523e00/0x859911ad686a05b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076038.409088:0:14306:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181523e00/0x859911ad686a05b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076038.409121:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700824192:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787076038.409162:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076038.409201:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1840 going to sleep for 11 seconds 00000100:00100000:0.0:1787076038.409257:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700824192 00000100:00100000:0.0:1787076038.409263:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700824192 00000100:00100000:0.0:1787076038.409300:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787076038.409309:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+11:14306:x1873884700824192:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787076038.409320:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787076038.409335:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961bfe68e00/0x859911ad686a05c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a05b9 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076038.409358:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961bfe68e00/0x859911ad686a05c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a05b9 expref: 12 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076038.409368:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961bfe68e00/0x859911ad686a05c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a05b9 expref: 12 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076038.409377:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe68e00, rc 0) 00000100:00100000:0.0:1787076038.409573:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+12:14306:x1873884700824192:12345-0@lo:101:mount.lustre.0 Request processed in 265us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076038.409580:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787076038.409867:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700824192:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787076038.409881:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181523e00/0x859911ad686a05b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a05c0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076038.409890:0:14306:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181523e00/0x859911ad686a05b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a05c0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076038.409936:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700824320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787076038.409966:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076038.410030:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1840 going to sleep for 11 seconds 00000100:00100000:2.0:1787076038.410068:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700824320 00000100:00100000:2.0:1787076038.410073:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700824320 00000100:00100000:2.0:1787076038.410142:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787076038.410150:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+12:14306:x1873884700824320:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787076038.410507:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+12:14306:x1873884700824320:12345-0@lo:501:mount.lustre.0 Request processed in 358us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076038.410525:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787076038.410735:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1844e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700824320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787076038.410768:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700824448:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787076038.410885:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076038.410907:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618954b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787076038.410921:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700824448 00000100:00100000:0.0:1787076038.410931:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700824448 00000100:00100000:0.0:1787076038.411001:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787076038.411008:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+12:14306:x1873884700824448:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787076038.411158:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+12:14306:x1873884700824448:12345-0@lo:503:mount.lustre.0 Request processed in 151us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076038.411165:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787076038.411202:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700824448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787076038.414362:0:14351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51646941-6761-4bd4-bf4b-97125ced6c1b:14351:1873884700824576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787076038.414445:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076038.414525:0:14351:0:(client.c:2702:ptlrpc_set_wait()) set ffff996185da8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787076038.416098:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700824576 00000100:00100000:1.0:1787076038.416112:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700824576 00000100:00100000:1.0:1787076038.420065:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787076038.420081:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+12:14351:x1873884700824576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787076038.420385:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+12:14351:x1873884700824576:12345-0@lo:502:llog_process_th.0 Request processed in 307us (5938us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076038.420393:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787076038.421111:0:14351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51646941-6761-4bd4-bf4b-97125ced6c1b:14351:1873884700824576:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787076038.421244:0:14351:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787076038.421262:0:14351:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99619183cd40) 00000020:00000080:2.0:1787076038.421281:0:14351:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787076038.421448:0:14351:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9961893b3000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787076038.421453:0:14351:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9961893b3000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787076038.421455:0:14351:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9961893b3000 4 00010000:00080000:2.0:1787076038.421485:0:14351:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9961c14c6000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.150@tcp at head 00010000:00010000:2.0:1787076038.430522:0:14351:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787076038.430745:0:14351:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787076038.430794:0:14351:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787076038.430809:0:14351:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x859911ad686a05ce 00000100:00080000:2.0:1787076038.430819:0:14351:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787076038.430824:0:14351:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9961c14c6000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:2.0:1787076038.430857:0:14351:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9961a6e44380 x1873884700824704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787076038.430884:0:14351:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787076038.430939:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873884700824704:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787076038.431025:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076038.431500:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700824704 00000100:00100000:0.0:1787076038.431509:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700824704 00000100:00100000:0.0:1787076038.431546:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787076038.431553:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1873884700824704:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787076038.431619:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1873884700824704:12345-0@lo:38:llog_process_th.0 Request processed in 65us (594us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787076038.431627:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787076038.431697:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787076038.431705:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961c14c6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787076038.431710:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787076038.431713:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873884700824704:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787076038.431826:0:14351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51646941-6761-4bd4-bf4b-97125ced6c1b:14351:1873884700824832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787076038.431872:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076038.431906:0:14351:0:(client.c:2702:ptlrpc_set_wait()) set ffff996185da8240 going to sleep for 11 seconds 00000100:00100000:0.0:1787076038.432225:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700824832 00000100:00100000:0.0:1787076038.432231:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700824832 00000100:00100000:0.0:1787076038.432273:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787076038.432281:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+12:14351:x1873884700824832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787076038.432541:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+12:14351:x1873884700824832:12345-0@lo:502:llog_process_th.0 Request processed in 261us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076038.432549:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787076038.433715:0:14351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51646941-6761-4bd4-bf4b-97125ced6c1b:14351:1873884700824832:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787076038.433754:0:14351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787076038.433899:0:14306:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787076038.433975:0:14306:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787076038.433988:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181523e00/0x859911ad686a05b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a05c0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.433998:0:14306:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181523e00/0x859911ad686a05b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a05c0 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787076038.434044:0:14306:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787076038.434046:0:14306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787076038.434047:0:14306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787076038.434049:0:14306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787076038.434050:0:14306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787076038.434052:0:14306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787076038.434053:0:14306:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787076038.434054:0:14306:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787076038.434056:0:14306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787076038.434058:0:14306:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787076038.434061:0:14306:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787076038.434064:0:14306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787076038.434065:0:14306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787076038.434066:0:14306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787076038.434067:0:14306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787076038.434068:0:14306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787076038.434069:0:14306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787076038.434070:0:14306:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787076038.434071:0:14306:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787076038.434072:0:14306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787076038.434073:0:14306:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787076038.434105:0:14306:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787076038.434122:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700824960:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787076038.434172:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076038.434206:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961a0398d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787076038.434297:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700824960 00000100:00100000:0.0:1787076038.434303:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700824960 00000100:00100000:0.0:1787076038.434369:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787076038.434379:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+12:14306:x1873884700824960:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787076038.435258:0:14318:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787076038.435277:0:14318:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787076038.482146:0:14318:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787076038.482164:0:14318:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787076038.483077:0:14339:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787076038.483084:0:14339:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787076038.483105:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9961bf632200/0x859911ad686a05d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.483125:0:14339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9961c1840400/0x859911ad686a05a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a059d expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.483132:0:14339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9961bf632200/0x859911ad686a05d5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.483174:0:14339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9961c1840400/0x859911ad686a05a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad686a059d expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.483188:0:14339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9961c1840400/0x859911ad686a05a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad686a059d expref: 12 pid: 14318 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076038.483203:0:14339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14339:1873884700825088:0@lo:104: 00000100:00100000:1.0:1787076038.483268:0:14339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076038.483306:0:14339:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191860840 going to sleep for 11 seconds 00000100:00100000:0.0:1787076038.483402:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700825088 00000100:00100000:0.0:1787076038.483409:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700825088 00000100:00100000:0.0:1787076038.483458:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787076038.483467:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51646941-6761-4bd4-bf4b-97125ced6c1b+3:14339:x1873884700825088:12345-0@lo:104: 00010000:00010000:0.0:1787076038.483480:0:14307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad686a059d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad686a05a4 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076038.483531:0:14307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787076038.483537:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51646941-6761-4bd4-bf4b-97125ced6c1b+3:14339:x1873884700825088:12345-0@lo:104: Request processed in 72us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076038.483545:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787076038.483615:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787076038.483621:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad686a059d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad686a05a4 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.483630:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522200 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787076038.483633:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad686a059d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad686a05a4 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.483676:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad686a059d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad686a05a4 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787076038.483684:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad686a059d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad686a05a4 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787076038.483691:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787076038.483719:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad686a059d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a05a4 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.483726:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787076038.484392:0:14339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14339:1873884700825088:0@lo:104: 00010000:00010000:0.0:1787076038.484417:0:14339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9961bf632200/0x859911ad686a05d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.484485:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad686a059d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a05a4 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.484494:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181522200/0x859911ad686a059d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a05a4 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.484515:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076038.484517:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076038.484519:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787076038.484664:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51646941-6761-4bd4-bf4b-97125ced6c1b:3312:1873884700825216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787076038.484711:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076038.484995:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700825216 00000100:00100000:1.0:1787076038.485002:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700825216 00010000:00010000:1.0:1787076038.485025:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9961c1840400/0x859911ad686a05a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad686a059d expref: 13 pid: 14318 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076038.485097:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787076038.485107:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51646941-6761-4bd4-bf4b-97125ced6c1b+13:3312:x1873884700825216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787076038.485120:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787076038.485126:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9961c1840400/0x859911ad686a05a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad686a059d expref: 13 pid: 14318 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.485148:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9961c1840400/0x859911ad686a05a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad686a059d expref: 13 pid: 14318 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.485162:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961c1840400/0x859911ad686a05a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad686a059d expref: 13 pid: 14318 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.485176:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9961bf632200/0x859911ad686a05d5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.485183:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961bf632200/0x859911ad686a05d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787076038.485198:0:14309:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002114030s 00010000:00010000:1.0:1787076038.485202:0:14309:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9961bf632200/0x859911ad686a05d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.485209:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9961bf632200/0x859911ad686a05d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.485217:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9961bf632200/0x859911ad686a05d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.485224:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9961bf632200/0x859911ad686a05d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.485231:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632200 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787076038.485235:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9961bf632200/0x859911ad686a05d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.485244:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9961bf632200/0x859911ad686a05d5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.485274:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9961bf632200/0x859911ad686a05d5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076038.485285:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787076038.485327:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1846d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51646941-6761-4bd4-bf4b-97125ced6c1b+12:3312:x1873884700825216:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076038.485336:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787076038.485384:0:14339:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9961bf632200/0x859911ad686a05d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076038.485392:0:14339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9961bf632200/0x859911ad686a05d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076038.485399:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961bf632200/0x859911ad686a05d5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076038.485952:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51646941-6761-4bd4-bf4b-97125ced6c1b:3312:1873884700825216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787076038.492196:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+11:14306:x1873884700824960:12345-0@lo:253:mount.lustre.0 Request processed in 57808us (58013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076038.492213:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787076038.492296:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:14306:1873884700824960:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787076038.492312:0:14306:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787076038.492316:0:14306:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787076038.492318:0:14306:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787076038.492319:0:14306:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787076038.492321:0:14306:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787076038.492322:0:14306:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787076038.492323:0:14306:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787076038.492325:0:14306:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787076038.492326:0:14306:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787076038.492328:0:14306:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787076038.492329:0:14306:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787076038.492354:0:14306:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787076038.498237:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787076038.498401:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787076038.498696:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787076038.498852:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787076038.499114:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787076038.499281:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787076038.500531:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787076038.501034:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787076038.501320:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787076038.501540:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787076038.502085:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787076038.502247:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1787076038.523690:0:14306:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787076038.524257:0:14306:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787076038.524376:0:14362:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787076038.524381:0:14362:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1787076038.524498:0:14363:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1787076038.524570:0:14363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787076038.526675:0:14363:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787076038.526752:0:14363:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787076038.526756:0:14363:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1787076038.529956:0:14306:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787076038.530138:0:14306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787076038.530548:0:14306:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787076038.530562:0:14306:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787076038.530772:0:14306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787076038.532146:0:14306:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787076038.532979:0:14306:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787076038.533018:0:14306:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787076038.534545:0:14306:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787076038.539575:0:14306:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787076038.561751:0:14306:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787076038.561865:0:14306:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb0b1c1d87988 00100000:10000000:3.0:1787076038.561873:0:14306:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787076038.562468:0:14306:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787076038.562482:0:14306:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.150@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787076038.562493:0:14306:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787076038.562511:0:14306:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1787076039.112960:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787076039.496286:0:14356:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1787076039.816489:0:14321:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787076039.816497:0:14321:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9961893b3000 from 6 10000000:01000000:3.0:1787076039.816502:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787076039.816547:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad686a05dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076039.816560:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad686a05dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076039.816583:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad686a05dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076039.816610:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700825344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787076039.816721:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076039.816772:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961900893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787076039.816897:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700825344 00000100:00100000:0.0:1787076039.816904:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700825344 00000100:00100000:0.0:1787076039.816954:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787076039.816964:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfd7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+11:14321:x1873884700825344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787076039.816978:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787076039.816991:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961bfe69400/0x859911ad686a05e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a05dc expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076039.817014:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961bfe69400/0x859911ad686a05e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a05dc expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076039.817026:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961bfe69400/0x859911ad686a05e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a05dc expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076039.817036:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe69400, rc 0) 00000100:00100000:0.0:1787076039.817093:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfd7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+12:14321:x1873884700825344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076039.817117:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787076039.821370:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700825344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787076039.821401:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad686a05dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a05e3 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076039.821429:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad686a05dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a05e3 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076039.821495:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700825472:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787076039.821557:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076039.821603:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961900893c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787076039.821960:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700825472 00000100:00100000:1.0:1787076039.821967:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700825472 00000100:00100000:1.0:1787076039.822010:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787076039.822019:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfd7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+12:14321:x1873884700825472:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787076039.822040:0:14318:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787076039.822059:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787076039.822062:0:14318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787076039.822148:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfd7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+12:14321:x1873884700825472:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076039.822162:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787076039.822665:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700825472:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787076039.823050:0:14321:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787076039.823060:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad686a05dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a05e3 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076039.823072:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad686a05dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a05e3 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076040.136257:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787076040.521569:0:14356:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787076041.164433:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076042.187767:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787076042.685450:0:14606:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787076043.208030:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787076043.464907:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787076043.464914:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787076043.464916:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787076043.464920:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787076043.464932:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787076043.464936:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787076043.464940:0:8:0:(import.c:65:import_set_state_nolock()) ffff9961c14c6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787076043.464954:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9961c14c6000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:1.0:1787076043.464981:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9961b52e5880 x1873884700825728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787076043.465363:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51646941-6761-4bd4-bf4b-97125ced6c1b:3313:1873884700825600:0@lo:400:kworker.0 00000100:00100000:2.0:1787076043.465446:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076043.465542:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700825600 00000100:00100000:2.0:1787076043.465562:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700825600 00000100:00100000:2.0:1787076043.465608:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787076043.465617:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfd7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+12:3313:x1873884700825600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787076043.465858:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfd7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+12:3313:x1873884700825600:12345-0@lo:400:kworker.0 Request processed in 241us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076043.465866:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787076043.465907:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873884700825728:0@lo:38:kworker.0 00000100:00100000:1.0:1787076043.466023:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51646941-6761-4bd4-bf4b-97125ced6c1b:3313:1873884700825600:0@lo:400:kworker.0 00000100:00100000:2.0:1787076043.466068:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076043.466148:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700825728 00000100:00100000:1.0:1787076043.466153:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700825728 00000100:00100000:1.0:1787076043.466178:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787076043.466184:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1873884700825728:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787076043.466208:0:14325:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:1.0:1787076043.466244:0:14325:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x859911ad686a05ea 00000004:00100000:1.0:1787076043.466259:0:14325:0:(mdt_handler.c:7351:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787076043.466436:0:14325:0:(import.c:65:import_set_state_nolock()) ffff9961a6f26800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787076043.466481:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873884700825728:12345-0@lo:38:kworker.0 Request processed in 295us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076043.466508:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787076043.471636:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9961b52e5880 x1873884700825728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787076053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787076043.471686:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787076043.471696:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787076043.471701:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787076043.471705:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961c14c6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787076043.471713:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873884700825728:0@lo:38:kworker.0 00010000:00010000:0.0:1787076044.231843:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076045.258744:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787076045.359137:0:14756:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd92ceeaa0 20000000:00000080:1.0:1787076045.359154:0:14756:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9961b67f3c00 uarg=0000000000000000 20000000:01000000:1.0:1787076045.359190:0:14756:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787076045.359198:0:14756:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787076045.359202:0:14756:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787076045.360520:0:14757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787076045.360686:0:14756:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787076045.370359:0:14756:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787076045.370392:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9961c1841e00/0x859911ad686a05f1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.370412:0:14756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9961bf633c00/0x859911ad686a05b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a05ab expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.370420:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9961c1841e00/0x859911ad686a05f1 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.370478:0:14756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9961bf633c00/0x859911ad686a05b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad686a05ab expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.370508:0:14756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9961bf633c00/0x859911ad686a05b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad686a05ab expref: 11 pid: 14317 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076045.370522:0:14756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14756:1873884700825856:0@lo:104: 00000100:00100000:2.0:1787076045.370585:0:14756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076045.371535:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700825856 00000100:00100000:1.0:1787076045.371547:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700825856 00000100:00100000:1.0:1787076045.371855:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787076045.371868:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51646941-6761-4bd4-bf4b-97125ced6c1b+3:14756:x1873884700825856:12345-0@lo:104: 00010000:00010000:1.0:1787076045.371884:0:14308:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad686a05ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad686a05b2 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076045.372045:0:14756:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618b8edd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787076045.372072:0:14756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14756:1873884700825856:0@lo:104: 00010000:00010000:2.0:1787076045.372097:0:14756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9961c1841e00/0x859911ad686a05f1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076045.372372:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787076045.372380:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51646941-6761-4bd4-bf4b-97125ced6c1b+3:14756:x1873884700825856:12345-0@lo:104: Request processed in 515us (1793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076045.372389:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787076045.372447:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076045.372463:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad686a05ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad686a05b2 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.372471:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523c00 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:2.0:1787076045.372475:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad686a05ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad686a05b2 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.372485:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad686a05ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad686a05b2 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787076045.372493:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad686a05ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad686a05b2 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787076045.372499:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787076045.372539:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad686a05ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a05b2 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.372546:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787076045.372591:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad686a05ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a05b2 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.372607:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181523c00/0x859911ad686a05ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a05b2 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.372626:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076045.372629:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076045.372630:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787076045.372987:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:51646941-6761-4bd4-bf4b-97125ced6c1b:3314:1873884700825984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787076045.373200:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076045.375117:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700825984 00000100:00100000:2.0:1787076045.375132:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700825984 00010000:00010000:2.0:1787076045.375167:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9961bf633c00/0x859911ad686a05b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad686a05ab expref: 12 pid: 14317 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076045.375353:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787076045.375363:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51646941-6761-4bd4-bf4b-97125ced6c1b+12:3314:x1873884700825984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787076045.376300:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787076045.376312:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9961bf633c00/0x859911ad686a05b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad686a05ab expref: 12 pid: 14317 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.376328:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9961bf633c00/0x859911ad686a05b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad686a05ab expref: 12 pid: 14317 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.376346:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961bf633c00/0x859911ad686a05b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad686a05ab expref: 12 pid: 14317 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.376363:0:14310:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9961c1841e00/0x859911ad686a05f1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.376386:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961c1841e00/0x859911ad686a05f1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.376424:0:14310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9961c1841e00/0x859911ad686a05f1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.376431:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9961c1841e00/0x859911ad686a05f1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.376437:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9961c1841e00/0x859911ad686a05f1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.376443:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9961c1841e00/0x859911ad686a05f1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.376450:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841e00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076045.376464:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9961c1841e00/0x859911ad686a05f1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.376473:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9961c1841e00/0x859911ad686a05f1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.376495:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9961c1841e00/0x859911ad686a05f1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076045.376507:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787076045.376533:0:14756:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9961c1841e00/0x859911ad686a05f1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076045.376552:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9961c1841e00/0x859911ad686a05f1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076045.376559:0:14756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961c1841e00/0x859911ad686a05f1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076045.376590:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51646941-6761-4bd4-bf4b-97125ced6c1b+11:3314:x1873884700825984:12345-0@lo:103:ldlm_bl.0 Request processed in 1227us (3388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076045.376599:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787076045.376662:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:51646941-6761-4bd4-bf4b-97125ced6c1b:3314:1873884700825984:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787076046.282965:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787076046.663953:0:14321:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787076046.663965:0:14321:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9961893b3000 from 10 10000000:01000000:1.0:1787076046.663997:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787076046.664070:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bf632400/0x859911ad686a05f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076046.664083:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9961bf632400/0x859911ad686a05f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076046.664097:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9961bf632400/0x859911ad686a05f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076046.664132:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700826112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787076046.664247:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076046.664324:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961897a5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787076046.664671:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700826112 00000100:00100000:0.0:1787076046.664682:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700826112 00000100:00100000:0.0:1787076046.664757:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787076046.664769:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfd7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+11:14321:x1873884700826112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787076046.664786:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787076046.664807:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961bfe69600/0x859911ad686a05ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a05f8 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076046.664835:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961bfe69600/0x859911ad686a05ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a05f8 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076046.664847:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961bfe69600/0x859911ad686a05ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a05f8 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076046.664858:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe69600, rc 0) 00000100:00100000:0.0:1787076046.664927:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfd7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+12:14321:x1873884700826112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076046.664934:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787076046.665216:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700826112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787076046.665237:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9961bf632400/0x859911ad686a05f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a05ff expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076046.665248:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9961bf632400/0x859911ad686a05f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a05ff expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076046.665342:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700826240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787076046.665378:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076046.665419:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff996190089480 going to sleep for 11 seconds 00000100:00100000:1.0:1787076046.665986:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700826240 00000100:00100000:1.0:1787076046.665993:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700826240 00000100:00100000:1.0:1787076046.666055:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787076046.666066:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfd7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+12:14321:x1873884700826240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787076046.666451:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfd7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+12:14321:x1873884700826240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 386us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076046.666459:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787076046.667014:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700826240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787076046.667140:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700826368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787076046.667212:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076046.667255:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787076046.667406:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700826368 00000100:00100000:2.0:1787076046.667415:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700826368 00000100:00100000:2.0:1787076046.667473:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787076046.667483:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996198719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+12:14321:x1873884700826368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787076046.668186:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996198719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+12:14321:x1873884700826368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 701us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076046.668196:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787076046.675540:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700826368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787076046.679270:0:14818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787076046.694950:0:14321:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787076046.695004:0:14321:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787076046.695021:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bf632400/0x859911ad686a05f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a05ff expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076046.695036:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961bf632400/0x859911ad686a05f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a05ff expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076047.303822:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076048.327793:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787076048.583783:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787076038/real 1787076038] req@ffff996184e8d180 x1873884700823040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787076048 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787076048.583814:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996184e8d180 x1873884700823040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787076048 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787076048.583824:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787076038/real 1787076038] req@ffff9961b52e6680 x1873884700822912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787076048 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787076048.583861:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9961b52e6680 x1873884700822912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787076048 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787076048.583879:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961bf061800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787076048.583902:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787076048.583907:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700823040:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787076048.584022:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961b00b2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787076048.584029:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787076048.584032:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700822912:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787076048.584422:0:12638:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787076048.584428:0:12638:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787076048.584431:0:12638:0:(import.c:65:import_set_state_nolock()) ffff9961b00b2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787076048.584436:0:12638:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 420 00000100:00080000:0.0:1787076048.584442:0:12638:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787076048.584449:0:12638:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9961b00b2000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:0.0:1787076048.584470:0:12638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996184e8ea00 x1873884700826624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787076048.584496:0:12638:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787076048.584499:0:12638:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787076048.584501:0:12638:0:(import.c:65:import_set_state_nolock()) ffff9961bf061800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787076048.584504:0:12638:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 420 00000100:00080000:0.0:1787076048.584507:0:12638:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787076048.584510:0:12638:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9961bf061800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:0.0:1787076048.584523:0:12638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996184e8fb80 x1873884700826752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787076048.584532:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51646941-6761-4bd4-bf4b-97125ced6c1b:3311:1873884700826496:0@lo:400:kworker.0 00000100:00100000:0.0:1787076048.584559:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700826880:0@lo:400:kworker.0 00000100:00100000:0.0:1787076048.584622:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076048.584623:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076048.584888:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700826624:0@lo:8:kworker.0 00000400:00000100:0.0:1787076048.584914:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873884700826624 offset 0 length 520: 4 00000100:00100000:0.0:1787076048.584939:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700826752:0@lo:8:kworker.0 00000400:00000100:0.0:1787076048.584960:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873884700826752 offset 0 length 520: 4 00000100:00100000:3.0:1787076048.585019:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700826496 00000100:00100000:3.0:1787076048.585027:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700826496 00000100:00100000:3.0:1787076048.585078:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787076048.585088:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619871b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+12:3311:x1873884700826496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787076048.585095:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700826880 00000100:00100000:2.0:1787076048.585101:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700826880 00000100:00100000:3.0:1787076048.585145:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619871b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+12:3311:x1873884700826496:12345-0@lo:400:kworker.0 Request processed in 58us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076048.585153:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787076048.585166:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787076048.585176:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700826880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787076048.585201:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51646941-6761-4bd4-bf4b-97125ced6c1b:3311:1873884700826496:0@lo:400:kworker.0 00000100:00100000:2.0:1787076048.585227:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700826880:12345-0@lo:400:kworker.0 Request processed in 53us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076048.585234:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787076048.585296:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff996184e8c000 x1873884700826880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787076064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787076048.585307:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700826880:0@lo:400:kworker.0 00010000:00010000:3.0:1787076049.351920:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787076049.992126:0:15005:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787076049.992133:0:15005:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787076049.992536:0:15005:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9961bf087000 00000020:01000004:2.0:1787076049.992558:0:15005:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787076049.992573:0:15005:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787076049.992604:0:15005:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9961ba9599c0) 00000020:00000080:2.0:1787076049.992630:0:15005:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787076050.057580:0:15005:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787076050.063606:0:15005:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787076050.065982:0:15005:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787076050.066229:0:15005:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787076050.066537:0:15005:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787076050.066998:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 337: rc = 0 00100000:10000000:3.0:1787076050.067080:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 337: rc = 0 00100000:10000000:3.0:1787076050.067153:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 337: rc = 0 00100000:10000000:3.0:1787076050.067744:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 346: rc = 0 00100000:10000000:3.0:1787076050.068527:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 346: rc = 0 00100000:10000000:3.0:1787076050.068867:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 346: rc = 0 00100000:10000000:3.0:1787076050.069240:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 346: rc = 0 00100000:10000000:3.0:1787076050.069582:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 346: rc = 0 00100000:10000000:3.0:1787076050.070244:0:15005:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 346: rc = 0 00000020:00000080:3.0:1787076050.071865:0:15005:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787076050.071877:0:15005:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787076050.071888:0:15005:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x859911ad686a060d 00000020:01000004:3.0:1787076050.071896:0:15005:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787076050.071916:0:15005:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787076050.071919:0:15005:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787076050.071925:0:15005:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787076050.071929:0:15005:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787076050.071943:0:15005:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9961b00999c0) 00000020:00000080:3.0:1787076050.071953:0:15005:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1787076050.073248:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787076050.073497:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787076050.073506:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787076050.080958:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787076050.080980:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787076050.081664:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787076050.081677:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787076050.089814:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787076050.090425:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787076050.090433:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787076050.091101:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787076050.091113:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787076050.136895:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787076050.138553:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787076050.138565:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787076050.141307:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787076050.141324:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787076050.144418:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787076050.144433:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787076050.151274:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787076050.151840:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787076050.151848:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787076050.152674:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787076050.152689:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787076050.211970:0:15005:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787076050.212260:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787076050.212268:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787076050.213514:0:15005:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787076050.213526:0:15005:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787076050.214538:0:15005:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787076050.214565:0:15005:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787076050.214571:0:15005:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787076050.241481:0:15005:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787076050.241521:0:15005:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.150@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787076050.241526:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787076050.241528:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787076050.241529:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787076050.241530:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787076050.241531:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787076050.241533:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787076050.241534:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787076050.241536:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787076050.241538:0:15005:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787076050.241542:0:15005:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787076050.241544:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787076050.241545:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787076050.241546:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787076050.241552:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787076050.241553:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787076050.241554:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787076050.241555:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787076050.241556:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787076050.241557:0:15005:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787076050.241585:0:15005:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787076050.241606:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1844380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700827008:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787076050.241842:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076050.241969:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961a037ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787076050.242127:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700827008 00000100:00100000:1.0:1787076050.242135:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700827008 00000100:00100000:1.0:1787076050.242285:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787076050.242399:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996198718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+12:15005:x1873884700827008:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787076050.242430:0:14317:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787076050.242434:0:14317:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787076050.242438:0:14317:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787076050.255144:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996198718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+12:15005:x1873884700827008:12345-0@lo:253:mount.lustre.0 Request processed in 12841us (13294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076050.255160:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787076050.255367:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1844380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700827008:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787076050.255383:0:15005:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787076050.255386:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787076050.255388:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787076050.255390:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787076050.255391:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787076050.255393:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787076050.255394:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787076050.255396:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787076050.255397:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787076050.255399:0:15005:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787076050.255417:0:15005:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9961bf087000 from lustre-OST0000 10000000:01000000:3.0:1787076050.255444:0:15005:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787076050.255446:0:15005:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787076050.255452:0:15005:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9961c1804d40 local copy 00010000:00010000:3.0:1787076050.255463:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe68200/0x859911ad686a0503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a050a expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076050.256074:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1844380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700827136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787076050.256114:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076050.256261:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961a037e300 going to sleep for 11 seconds 00000100:00100000:2.0:1787076050.256401:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700827136 00000100:00100000:2.0:1787076050.256417:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700827136 00000100:00100000:2.0:1787076050.256499:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787076050.256516:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996198718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+12:15005:x1873884700827136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787076050.256699:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996198718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+12:15005:x1873884700827136:12345-0@lo:501:mount.lustre.0 Request processed in 185us (583us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787076050.256706:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787076050.256787:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1844380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700827136:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787076050.256802:0:15005:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787076050.256985:0:15005:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787076050.256993:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe68200/0x859911ad686a0503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a050a expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076050.257002:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961bfe68200/0x859911ad686a0503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a050a expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787076050.257023:0:15005:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9961bf087000 10000000:01000000:0.0:1787076050.257028:0:15005:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787076050.257032:0:15005:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9961c1804d40 10000000:01000000:0.0:1787076050.257034:0:15005:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787076050.257037:0:15005:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9961c1804d40 from 1 10000000:01000000:0.0:1787076050.257040:0:15005:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787076050.257068:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe69a00/0x859911ad686a061b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076050.257076:0:15005:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9961bfe69a00/0x859911ad686a061b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076050.257093:0:15005:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9961bfe69a00/0x859911ad686a061b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076050.257108:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700827264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787076050.257138:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076050.257757:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787076050.257988:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700827264 00000100:00100000:3.0:1787076050.257995:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700827264 00000100:00100000:3.0:1787076050.258034:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787076050.258042:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996198719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+12:15005:x1873884700827264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787076050.258052:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787076050.258067:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181523400/0x859911ad686a0622 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a061b expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076050.258089:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181523400/0x859911ad686a0622 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a061b expref: 13 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076050.258099:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181523400/0x859911ad686a0622 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a061b expref: 13 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076050.258108:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523400, rc 0) 00000100:00100000:3.0:1787076050.258262:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996198719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+13:15005:x1873884700827264:12345-0@lo:101:mount.lustre.0 Request processed in 220us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076050.258270:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787076050.258895:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700827264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787076050.258914:0:15005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9961bfe69a00/0x859911ad686a061b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0622 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076050.258958:0:15005:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9961bfe69a00/0x859911ad686a061b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a0622 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787076050.258980:0:15005:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787076050.259045:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe69a00/0x859911ad686a061b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0622 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076050.259053:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961bfe69a00/0x859911ad686a061b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0622 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787076050.259062:0:15005:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787076050.259069:0:15005:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787076050.259080:0:15005:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787076050.259083:0:15005:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787076050.259110:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe69800/0x859911ad686a0629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076050.259117:0:15005:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9961bfe69800/0x859911ad686a0629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076050.259137:0:15005:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9961bfe69800/0x859911ad686a0629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076050.259155:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700827392:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787076050.259194:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076050.259228:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787076050.259287:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700827392 00000100:00100000:3.0:1787076050.259292:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700827392 00000100:00100000:2.0:1787076050.259394:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787076050.259410:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a17a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+13:15005:x1873884700827392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787076050.259420:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787076050.259431:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961c1841600/0x859911ad686a0630 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a0629 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.259449:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961c1841600/0x859911ad686a0630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a0629 expref: 14 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.259458:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961c1841600/0x859911ad686a0630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a0629 expref: 14 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.259466:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1841600, rc 0) 00000100:00100000:2.0:1787076050.259516:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a17a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+14:15005:x1873884700827392:12345-0@lo:101:mount.lustre.0 Request processed in 110us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076050.259523:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787076050.259726:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700827392:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787076050.259747:0:15005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9961bfe69800/0x859911ad686a0629 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0630 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076050.259756:0:15005:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9961bfe69800/0x859911ad686a0629 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a0630 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787076050.260690:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787076050.263213:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787076050.264016:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787076050.264070:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787076050.264106:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787076050.264156:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787076050.264446:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787076050.264486:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787076050.264623:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787076050.264632:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787076050.264850:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700827520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787076050.264975:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076050.265080:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787076050.265520:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700827520 00000100:00100000:3.0:1787076050.265528:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700827520 00000100:00100000:3.0:1787076050.265742:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787076050.265754:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+14:15005:x1873884700827520:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787076050.266154:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+14:15005:x1873884700827520:12345-0@lo:501:mount.lustre.0 Request processed in 402us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076050.266162:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787076050.266242:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700827520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787076050.266293:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700827648:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787076050.266334:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076050.268230:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787076050.268282:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700827648 00000100:00100000:2.0:1787076050.268291:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700827648 00000100:00100000:2.0:1787076050.268352:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787076050.268371:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+14:15005:x1873884700827648:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787076050.269153:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+14:15005:x1873884700827648:12345-0@lo:503:mount.lustre.0 Request processed in 789us (2815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076050.269173:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787076050.269964:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700827648:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787076050.272776:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787076050.272873:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700827776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787076050.272963:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076050.273009:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787076050.273289:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700827776 00000100:00100000:1.0:1787076050.273297:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700827776 00000100:00100000:1.0:1787076050.273348:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787076050.273367:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+14:15005:x1873884700827776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787076050.273668:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+14:15005:x1873884700827776:12345-0@lo:502:mount.lustre.0 Request processed in 311us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076050.273676:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787076050.273761:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700827776:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787076050.274006:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787076050.274057:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787076050.274354:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787076050.274541:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787076050.274586:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787076050.274622:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787076050.274701:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787076050.274736:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787076050.274778:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787076050.274825:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787076050.274862:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787076050.274911:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787076050.274950:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700827904:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787076050.275008:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076050.275245:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787076050.275418:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700827904 00000100:00100000:3.0:1787076050.275885:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700827904 00000100:00100000:3.0:1787076050.275944:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787076050.275954:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+14:15005:x1873884700827904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787076050.276804:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+14:15005:x1873884700827904:12345-0@lo:502:mount.lustre.0 Request processed in 847us (1792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076050.276820:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787076050.277573:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700827904:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787076050.277727:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787076050.277750:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787076050.279420:0:15019:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787076050.279433:0:15019:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787076050.279439:0:15019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076050.279441:0:15019:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787076050.279446:0:15019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787076050.279463:0:15019:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9961b9e03380) 00000020:00000080:0.0:1787076050.279485:0:15019:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787076050.279491:0:15019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787076050.279623:0:15019:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9961bf087000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787076050.279630:0:15019:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787076050.279636:0:15019:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x859911ad686a063e 00010000:00010000:1.0:1787076050.284506:0:15019:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1787076050.284953:0:15019:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1787076050.289610:0:15019:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787076050.291437:0:15019:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787076050.291450:0:15019:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787076050.291457:0:15019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787076050.291459:0:15019:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787076050.291462:0:15019:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787076050.291465:0:15019:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787076050.291467:0:15019:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787076050.291468:0:15019:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787076050.291470:0:15019:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787076050.291472:0:15019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787076050.291473:0:15019:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787076050.291476:0:15019:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787076050.291479:0:15019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787076050.291480:0:15019:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787076050.291483:0:15019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787076050.291485:0:15019:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787076050.291488:0:15019:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787076050.291490:0:15019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787076050.291491:0:15019:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787076050.291493:0:15019:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787076050.291495:0:15019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787076050.291496:0:15019:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787076050.291499:0:15019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787076050.293255:0:15019:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787076050.293265:0:15019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787076050.293267:0:15019:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787076050.293271:0:15019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787076050.293847:0:15005:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787076050.293873:0:15005:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787076050.293893:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe69800/0x859911ad686a0629 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0630 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076050.293907:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961bfe69800/0x859911ad686a0629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0630 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787076050.293915:0:15005:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9961bf087000 from 1 10000000:01000000:3.0:1787076050.293918:0:15005:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787076050.293955:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522000/0x859911ad686a0645 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076050.293964:0:15005:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996181522000/0x859911ad686a0645 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076050.293975:0:15005:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181522000/0x859911ad686a0645 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076050.294002:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1844700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700828032:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787076050.294067:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076050.294114:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961a037e180 going to sleep for 11 seconds 00000100:00100000:1.0:1787076050.294286:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700828032 00000100:00100000:1.0:1787076050.294294:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700828032 00000100:00100000:1.0:1787076050.294346:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787076050.294355:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+14:15005:x1873884700828032:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787076050.294379:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787076050.294392:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961bf632e00/0x859911ad686a064c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a0645 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076050.294423:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961bf632e00/0x859911ad686a064c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a0645 expref: 15 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076050.294433:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961bf632e00/0x859911ad686a064c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a0645 expref: 15 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076050.294442:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632e00, rc 0) 00000100:00100000:1.0:1787076050.294491:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+15:15005:x1873884700828032:12345-0@lo:101:mount.lustre.0 Request processed in 136us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076050.294497:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787076050.294594:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1844700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700828032:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787076050.294608:0:15005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181522000/0x859911ad686a0645 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a064c expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076050.294629:0:15005:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181522000/0x859911ad686a0645 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a064c expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787076050.295297:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787076050.295958:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787076050.296198:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787076050.296243:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787076050.296306:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787076050.296315:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787076050.296394:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1844700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700828160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787076050.296455:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076050.296560:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961a037e180 going to sleep for 11 seconds 00000100:00100000:1.0:1787076050.300794:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700828160 00000100:00100000:1.0:1787076050.300808:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700828160 00000100:00100000:1.0:1787076050.300874:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787076050.300884:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+15:15005:x1873884700828160:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787076050.301943:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+15:15005:x1873884700828160:12345-0@lo:501:mount.lustre.0 Request processed in 1055us (5483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076050.302095:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787076050.307374:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1844700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700828160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787076050.307445:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1844700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700828288:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787076050.307521:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076050.307567:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961a037e180 going to sleep for 11 seconds 00000100:00100000:1.0:1787076050.307587:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700828288 00000100:00100000:1.0:1787076050.307595:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700828288 00000100:00100000:1.0:1787076050.307669:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787076050.307680:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+15:15005:x1873884700828288:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787076050.307889:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+15:15005:x1873884700828288:12345-0@lo:503:mount.lustre.0 Request processed in 210us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076050.307897:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787076050.308571:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1844700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700828288:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787076050.309253:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787076050.309331:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1844700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700828416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787076050.309402:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076050.309447:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961a037e180 going to sleep for 11 seconds 00000100:00100000:1.0:1787076050.309469:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700828416 00000100:00100000:1.0:1787076050.309478:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700828416 00000100:00100000:1.0:1787076050.309528:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787076050.309536:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+15:15005:x1873884700828416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787076050.309745:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+15:15005:x1873884700828416:12345-0@lo:502:mount.lustre.0 Request processed in 209us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076050.309752:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787076050.309949:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1844700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700828416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787076050.310162:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787076050.310220:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787076050.310272:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787076050.310310:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787076050.310345:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787076050.310405:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787076050.310442:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787076050.310474:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787076050.310503:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700828544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787076050.310550:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076050.312169:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1600 going to sleep for 11 seconds 00000100:00100000:1.0:1787076050.313162:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700828544 00000100:00100000:1.0:1787076050.313172:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700828544 00000100:00100000:1.0:1787076050.313269:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787076050.313279:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+15:15005:x1873884700828544:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787076050.313552:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+15:15005:x1873884700828544:12345-0@lo:502:mount.lustre.0 Request processed in 274us (3000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076050.313560:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787076050.313953:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700828544:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787076050.314106:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787076050.314122:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787076050.315054:0:15023:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787076050.315070:0:15023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787076050.315073:0:15023:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787076050.315080:0:15023:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9961bf087000 00000020:00000080:2.0:1787076050.315082:0:15023:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787076050.315090:0:15023:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787076050.315093:0:15023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787076050.315095:0:15023:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787076050.315097:0:15023:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787076050.315099:0:15023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787076050.315100:0:15023:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787076050.315104:0:15023:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9961bf087000 00000020:00000080:2.0:1787076050.315105:0:15023:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787076050.315162:0:15023:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787076050.315167:0:15023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787076050.315168:0:15023:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787076050.315171:0:15023:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787076050.315173:0:15023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787076050.315175:0:15023:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787076050.315178:0:15023:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9961bf087000 00000020:00000080:2.0:1787076050.315180:0:15023:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787076050.315219:0:15023:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787076050.315222:0:15023:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787076050.315224:0:15023:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787076050.315227:0:15023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787076050.317154:0:15005:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787076050.317186:0:15005:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787076050.317207:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522000/0x859911ad686a0645 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a064c expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.317220:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181522000/0x859911ad686a0645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a064c expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787076050.317278:0:15005:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787076050.317287:0:15005:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9961bf087000 10000000:01000000:2.0:1787076050.317290:0:15005:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9961bf087000 10000000:01000000:2.0:1787076050.317294:0:15005:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787076050.317301:0:15005:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9961bf087000 from 1 10000000:01000000:2.0:1787076050.317303:0:15005:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787076050.317338:0:15005:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961c1840400/0x859911ad686a0653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.317346:0:15005:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9961c1840400/0x859911ad686a0653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.317367:0:15005:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9961c1840400/0x859911ad686a0653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076050.317392:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700828672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787076050.317465:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076050.317509:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff996183ee1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787076050.317748:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700828672 00000100:00100000:0.0:1787076050.317756:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700828672 00000100:00100000:1.0:1787076050.319173:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787076050.319186:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+15:15005:x1873884700828672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787076050.319201:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787076050.319217:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961bf632c00/0x859911ad686a065a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a0653 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076050.319245:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961bf632c00/0x859911ad686a065a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a0653 expref: 16 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076050.319256:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961bf632c00/0x859911ad686a065a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a0653 expref: 16 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076050.319264:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf632c00, rc 0) 00000100:00100000:1.0:1787076050.319331:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+16:15005:x1873884700828672:12345-0@lo:101:mount.lustre.0 Request processed in 148us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076050.319350:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787076050.319824:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700828672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787076050.319843:0:15005:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9961c1840400/0x859911ad686a0653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a065a expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076050.319852:0:15005:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9961c1840400/0x859911ad686a0653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a065a expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787076050.320457:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787076050.320752:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787076050.320990:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787076050.321032:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787076050.321065:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787076050.321128:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787076050.321168:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787076050.321217:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787076050.321254:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787076050.321287:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787076050.321335:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787076050.321386:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787076050.321423:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787076050.321471:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787076050.321507:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787076050.321542:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787076050.321591:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787076050.321627:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787076050.321709:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787076050.321762:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787076050.321799:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787076050.321834:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787076050.321885:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787076050.321918:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787076050.321946:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787076050.321994:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787076050.322032:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787076050.322065:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787076050.322113:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787076050.322149:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787076050.322224:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787076050.322240:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787076050.322322:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700828800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787076050.326104:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076050.328704:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787076050.332821:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700828800 00000100:00100000:2.0:1787076050.332835:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700828800 00000100:00100000:2.0:1787076050.332884:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787076050.332892:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996190f62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+16:15005:x1873884700828800:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787076050.333173:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996190f62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+16:15005:x1873884700828800:12345-0@lo:501:mount.lustre.0 Request processed in 281us (7073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076050.333181:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787076050.336035:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700828800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787076050.336091:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700828928:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787076050.336166:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076050.336219:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787076050.338124:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700828928 00000100:00100000:2.0:1787076050.338139:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700828928 00000100:00100000:2.0:1787076050.338188:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787076050.338199:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996190f60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+16:15005:x1873884700828928:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787076050.338432:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996190f60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+16:15005:x1873884700828928:12345-0@lo:503:mount.lustre.0 Request processed in 235us (2265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076050.338447:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787076050.338997:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700828928:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787076050.339564:0:15005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787076050.339671:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700829056:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787076050.339731:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076050.339774:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787076050.339922:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700829056 00000100:00100000:1.0:1787076050.339929:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700829056 00000100:00100000:1.0:1787076050.339962:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787076050.339970:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996190f63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+16:15005:x1873884700829056:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787076050.340184:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996190f63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+16:15005:x1873884700829056:12345-0@lo:502:mount.lustre.0 Request processed in 213us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076050.340192:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787076050.340287:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700829056:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787076050.340543:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787076050.340595:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787076050.340631:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787076050.340766:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787076050.341929:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787076050.342022:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787076050.342061:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787076050.342097:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787076050.342152:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787076050.342189:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787076050.342224:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787076050.342291:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787076050.342333:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787076050.342393:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787076050.342447:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787076050.342484:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787076050.342537:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787076050.342600:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787076050.342665:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787076050.342702:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787076050.342759:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787076050.345938:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787076050.346031:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787076050.346108:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787076050.346148:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787076050.346192:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787076050.346247:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787076050.346287:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787076050.346324:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787076050.347674:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787076050.347754:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787076050.347791:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787076050.348187:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787076050.348241:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787076050.348280:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787076050.348344:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787076050.348397:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787076050.348434:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787076050.348482:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787076050.348518:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787076050.348572:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700829184:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787076050.348673:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076050.348724:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191be1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787076050.349944:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700829184 00000100:00100000:1.0:1787076050.349954:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700829184 00000100:00100000:1.0:1787076050.350004:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787076050.350013:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+16:15005:x1873884700829184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787076050.350265:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+16:15005:x1873884700829184:12345-0@lo:502:mount.lustre.0 Request processed in 252us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076050.350274:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787076050.350777:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700829184:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787076050.351213:0:15005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787076050.351229:0:15005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787076050.354062:0:15028:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787076050.354079:0:15028:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9961ba958000) 00000020:00000080:2.0:1787076050.354101:0:15028:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1787076050.354247:0:15028:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9961bf087000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787076050.354252:0:15028:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9961bf087000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787076050.354254:0:15028:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9961bf087000 3 00010000:00080000:2.0:1787076050.354282:0:15028:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9961a6e00000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.150@tcp at head 00010000:00010000:2.0:1787076050.356673:0:15028:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787076050.356894:0:15028:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787076050.356934:0:15028:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787076050.356946:0:15028:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x859911ad686a0668 00000100:00080000:2.0:1787076050.356956:0:15028:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787076050.356962:0:15028:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9961a6e00000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:2.0:1787076050.356997:0:15028:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9961a6e47480 x1873884700829312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787076050.358692:0:15028:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787076050.358722:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787076050.358727:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787076050.358729:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787076050.358739:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787076050.358936:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787076050.358954:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873884700829440:0@lo:400:kworker.0 00000100:00100000:0.0:1787076050.359023:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076050.359190:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700829440 00000100:00100000:3.0:1787076050.359197:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700829440 00000100:00100000:3.0:1787076050.359239:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787076050.359248:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873884700829440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787076050.359313:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1873884700829440:12345-0@lo:400:kworker.0 Request processed in 66us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076050.359321:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787076050.359397:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9961c1845c00 x1873884700829440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787076066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787076050.359410:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1873884700829440:0@lo:400:kworker.0 00000100:00100000:2.0:1787076050.359490:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1873884700829312:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787076050.359537:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076050.359759:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700829312 00000100:00100000:2.0:1787076050.359764:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700829312 00000100:00100000:2.0:1787076050.359785:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787076050.359790:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1873884700829312:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787076050.359887:0:14324:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:2.0:1787076050.359933:0:14324:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x859911ad686a066f 00000004:00100000:2.0:1787076050.359948:0:14324:0:(mdt_handler.c:7351:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787076050.359984:0:14324:0:(import.c:65:import_set_state_nolock()) ffff996082dcf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787076050.360032:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873884700829312:12345-0@lo:38:llog_process_th.0 Request processed in 240us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076050.360039:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787076050.360069:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9961a6e47480 x1873884700829312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787076060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787076050.360079:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787076050.360087:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787076050.360093:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787076050.360097:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787076050.360100:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961a6e00000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787076050.360105:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1873884700829312:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787076050.365992:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787076050.366150:0:15005:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787076050.366175:0:15005:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787076050.366198:0:15005:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961c1840400/0x859911ad686a0653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a065a expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076050.366211:0:15005:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961c1840400/0x859911ad686a0653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a065a expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787076050.366259:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787076050.366262:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787076050.366263:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787076050.366264:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787076050.366265:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787076050.366271:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787076050.366272:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787076050.366274:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787076050.366275:0:15005:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787076050.366279:0:15005:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787076050.366281:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787076050.366282:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787076050.366283:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787076050.366284:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787076050.366284:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787076050.366285:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787076050.366286:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787076050.366288:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787076050.366288:0:15005:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787076050.366314:0:15005:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787076050.366335:0:15005:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700829568:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787076050.366412:0:15005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076050.366448:0:15005:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eeb900 going to sleep for 11 seconds 00000100:00100000:3.0:1787076050.366506:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700829568 00000100:00100000:3.0:1787076050.366514:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700829568 00000100:00100000:3.0:1787076050.366562:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787076050.366572:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+16:15005:x1873884700829568:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787076050.366598:0:14318:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787076050.366610:0:14318:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1787076050.375881:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1787076050.391815:0:14318:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787076050.391837:0:14318:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787076050.391952:0:14339:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787076050.391957:0:14339:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787076050.391980:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9961bf633800/0x859911ad686a0676 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076050.391999:0:14339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9961bfe69400/0x859911ad686a05e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a05dc expref: 16 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076050.392007:0:14339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9961bf633800/0x859911ad686a0676 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076050.392047:0:14339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9961bfe69400/0x859911ad686a05e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad686a05dc expref: 16 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076050.392062:0:14339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9961bfe69400/0x859911ad686a05e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad686a05dc expref: 16 pid: 14316 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076050.392096:0:14339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14339:1873884700829696:0@lo:104: 00000100:00100000:1.0:1787076050.392158:0:14339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076050.392202:0:14339:0:(client.c:2702:ptlrpc_set_wait()) set ffff996188f49f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787076050.392398:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700829696 00000100:00100000:0.0:1787076050.392406:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700829696 00000100:00100000:0.0:1787076050.392452:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787076050.392462:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51646941-6761-4bd4-bf4b-97125ced6c1b+3:14339:x1873884700829696:12345-0@lo:104: 00010000:00010000:0.0:1787076050.392475:0:14307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad686a05dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad686a05e3 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076050.392663:0:14307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787076050.392670:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51646941-6761-4bd4-bf4b-97125ced6c1b+3:14339:x1873884700829696:12345-0@lo:104: Request processed in 210us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076050.392678:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787076050.392754:0:14339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14339:1873884700829696:0@lo:104: 00010000:00010000:1.0:1787076050.392773:0:14339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9961bf633800/0x859911ad686a0676 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.392884:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076050.392892:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad686a05dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad686a05e3 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.392900:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522e00 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:2.0:1787076050.392904:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad686a05dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad686a05e3 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.392912:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad686a05dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad686a05e3 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787076050.392920:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad686a05dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad686a05e3 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787076050.392925:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787076050.392971:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad686a05dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a05e3 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.392978:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787076050.393007:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad686a05dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a05e3 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.393015:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181522e00/0x859911ad686a05dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a05e3 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.393033:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076050.393034:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076050.393036:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787076050.393044:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787076050.393056:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51646941-6761-4bd4-bf4b-97125ced6c1b:3313:1873884700829824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787076050.393089:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076050.393127:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700829824 00000100:00100000:2.0:1787076050.393131:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700829824 00010000:00010000:2.0:1787076050.393150:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9961bfe69400/0x859911ad686a05e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad686a05dc expref: 17 pid: 14316 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076050.393172:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787076050.393179:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51646941-6761-4bd4-bf4b-97125ced6c1b+17:3313:x1873884700829824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787076050.393188:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787076050.393194:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9961bfe69400/0x859911ad686a05e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad686a05dc expref: 17 pid: 14316 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.393205:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9961bfe69400/0x859911ad686a05e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad686a05dc expref: 17 pid: 14316 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.393218:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961bfe69400/0x859911ad686a05e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad686a05dc expref: 17 pid: 14316 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.393237:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9961bf633800/0x859911ad686a0676 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.393245:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961bf633800/0x859911ad686a0676 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787076050.393258:0:14311:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002114030s 00010000:00010000:2.0:1787076050.393262:0:14311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9961bf633800/0x859911ad686a0676 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.393269:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9961bf633800/0x859911ad686a0676 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.393274:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9961bf633800/0x859911ad686a0676 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.393280:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9961bf633800/0x859911ad686a0676 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.393285:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633800 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076050.393289:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9961bf633800/0x859911ad686a0676 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.393296:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9961bf633800/0x859911ad686a0676 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.393310:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9961bf633800/0x859911ad686a0676 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.393320:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787076050.393366:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51646941-6761-4bd4-bf4b-97125ced6c1b+16:3313:x1873884700829824:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076050.393374:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787076050.393406:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51646941-6761-4bd4-bf4b-97125ced6c1b:3313:1873884700829824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787076050.393422:0:14339:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9961bf633800/0x859911ad686a0676 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.393430:0:14339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9961bf633800/0x859911ad686a0676 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076050.393436:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961bf633800/0x859911ad686a0676 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076050.419196:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+15:15005:x1873884700829568:12345-0@lo:253:mount.lustre.0 Request processed in 52616us (52775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076050.419211:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787076050.419298:0:15005:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15005:1873884700829568:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787076050.419315:0:15005:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787076050.419318:0:15005:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787076050.419320:0:15005:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787076050.419321:0:15005:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787076050.419323:0:15005:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787076050.419324:0:15005:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787076050.419325:0:15005:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787076050.419327:0:15005:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787076050.419329:0:15005:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787076050.419330:0:15005:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787076050.419344:0:15005:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787076050.424346:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787076050.424604:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787076050.424935:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787076050.425094:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787076050.425231:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787076050.425460:0:15005:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787076050.426442:0:15005:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787076050.485598:0:15005:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787076050.485608:0:15005:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787076050.485662:0:15005:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787076050.485733:0:15005:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.150@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787076050.485752:0:15005:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787076050.485781:0:15005:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000040:00080000:3.0:1787076050.762101:0:14356:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787076051.401763:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787076051.655897:0:14321:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787076051.655906:0:14321:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9961893b3000 from 7 10000000:01000000:0.0:1787076051.655912:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787076051.655967:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe68000/0x859911ad686a067d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076051.655980:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9961bfe68000/0x859911ad686a067d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076051.655992:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9961bfe68000/0x859911ad686a067d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076051.656023:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700829952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787076051.656092:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076051.656212:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618ba5f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787076051.656985:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700829952 00000100:00100000:1.0:1787076051.656994:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700829952 00000100:00100000:1.0:1787076051.657053:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787076051.657063:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+15:14321:x1873884700829952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787076051.657076:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787076051.657093:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961bf633200/0x859911ad686a0684 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a067d expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076051.657117:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961bf633200/0x859911ad686a0684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a067d expref: 16 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076051.657146:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961bf633200/0x859911ad686a0684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a067d expref: 16 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076051.659017:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bf633200, rc 0) 00000100:00100000:1.0:1787076051.659171:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+16:14321:x1873884700829952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2103us (3071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076051.659180:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787076051.660589:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700829952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787076051.660621:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9961bfe68000/0x859911ad686a067d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0684 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076051.660634:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9961bfe68000/0x859911ad686a067d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a0684 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076051.660949:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700830080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787076051.661008:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076051.661126:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618ba5f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787076051.661180:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700830080 00000100:00100000:3.0:1787076051.661187:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700830080 00000100:00100000:3.0:1787076051.661301:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787076051.661310:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+16:14321:x1873884700830080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787076051.661345:0:14318:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787076051.661361:0:14318:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787076051.661364:0:14318:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787076051.661462:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+16:14321:x1873884700830080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 153us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076051.661470:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787076051.661536:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700830080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787076051.661595:0:14321:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787076051.661604:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe68000/0x859911ad686a067d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0684 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076051.661612:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961bfe68000/0x859911ad686a067d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0684 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076052.425697:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076053.448755:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076054.472295:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076055.495803:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787076055.753542:0:12638:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787076055.753549:0:12638:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787076055.753552:0:12638:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787076055.753556:0:12638:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787076055.753727:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700830336:0@lo:400:kworker.0 00000100:00100000:2.0:1787076055.753800:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076055.753843:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51646941-6761-4bd4-bf4b-97125ced6c1b:3311:1873884700830208:0@lo:400:kworker.0 00000100:00100000:2.0:1787076055.753875:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700830464:0@lo:400:kworker.0 00000100:00100000:3.0:1787076055.753884:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076055.753911:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076055.753953:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700830336 00000100:00100000:2.0:1787076055.753959:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700830336 00000100:00100000:2.0:1787076055.754005:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700830464 00000100:00100000:2.0:1787076055.754008:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700830464 00000100:00100000:2.0:1787076055.754046:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787076055.754055:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700830336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787076055.754126:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700830336:12345-0@lo:400:kworker.0 Request processed in 70us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076055.754138:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700830208 00000100:00100000:1.0:1787076055.754151:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700830208 00000100:00100000:1.0:1787076055.754181:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787076055.754189:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+16:3311:x1873884700830208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787076055.754232:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+16:3311:x1873884700830208:12345-0@lo:400:kworker.0 Request processed in 44us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076055.754240:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787076055.754472:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51646941-6761-4bd4-bf4b-97125ced6c1b:3311:1873884700830208:0@lo:400:kworker.0 00000100:00100000:3.0:1787076055.756137:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787076055.756378:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787076055.756469:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961a6e45880 x1873884700830336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787076071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787076055.756484:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700830336:0@lo:400:kworker.0 00000100:00080000:2.0:1787076055.756735:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787076055.758681:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700830464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787076055.759578:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700830464:12345-0@lo:400:kworker.0 Request processed in 3428us (5666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076055.759590:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787076055.759676:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961a6e46a00 x1873884700830464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787076071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787076055.760556:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700830464:0@lo:400:kworker.0 00010000:00010000:3.0:1787076056.523740:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787076056.688597:0:15369:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787076057.544281:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076058.573235:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076059.593058:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076060.624136:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787076060.872163:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787076060.872172:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787076060.872174:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787076060.872178:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787076060.872225:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700830720:0@lo:400:kworker.0 00000100:00100000:3.0:1787076060.872298:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076060.872380:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787076060.872388:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700830848:0@lo:400:kworker.0 00000100:00100000:3.0:1787076060.872412:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076060.872511:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700830720 00000100:00100000:0.0:1787076060.872520:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700830720 00000100:00100000:0.0:1787076060.872569:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700830848 00000100:00100000:0.0:1787076060.872572:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700830848 00000100:00100000:2.0:1787076060.872587:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787076060.872597:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51646941-6761-4bd4-bf4b-97125ced6c1b:3313:1873884700830592:0@lo:400:kworker.0 00000100:00100000:0.0:1787076060.872600:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787076060.872610:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700830720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787076060.872630:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076060.872682:0:14324:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787076060.872690:0:14324:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787076060.872704:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700830720:12345-0@lo:400:kworker.0 Request processed in 95us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076060.872711:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787076060.872732:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787076060.872738:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700830848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787076060.872764:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700830848:12345-0@lo:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076060.872770:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787076060.872786:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787076060.872840:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961c1847b80 x1873884700830848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787076076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787076060.872854:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700830848:0@lo:400:kworker.0 00010000:00080000:0.0:1787076060.872877:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961c1847100 x1873884700830720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787076076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787076060.872886:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700830720:0@lo:400:kworker.0 00000100:00100000:3.0:1787076060.873188:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700830592 00000100:00100000:3.0:1787076060.873193:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700830592 00000100:00100000:3.0:1787076060.873219:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787076060.873226:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+16:3313:x1873884700830592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787076060.873267:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+16:3313:x1873884700830592:12345-0@lo:400:kworker.0 Request processed in 42us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076060.873273:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787076060.873309:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51646941-6761-4bd4-bf4b-97125ced6c1b:3313:1873884700830592:0@lo:400:kworker.0 00000040:00080000:0.0:1787076061.000303:0:14356:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787076061.640179:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076062.663772:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787076063.626970:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787076048/real 1787076048] req@ffff996184e8ea00 x1873884700826624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787076063 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787076063.627004:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996184e8ea00 x1873884700826624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787076063 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787076063.627014:0:3310:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787076048/real 1787076048] req@ffff996184e8fb80 x1873884700826752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787076063 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787076063.627041:0:3310:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff996184e8fb80 x1873884700826752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787076063 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787076063.627061:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961b00b2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787076063.627106:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787076063.627110:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700826624:0@lo:8:kworker.0 00000100:00080000:1.0:1787076063.627117:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961bf061800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787076063.627123:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787076063.627126:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700826752:0@lo:8:kworker.0 00000100:00080000:3.0:1787076063.627635:0:12638:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787076063.627672:0:12638:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787076063.627676:0:12638:0:(import.c:65:import_set_state_nolock()) ffff9961b00b2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787076063.627682:0:12638:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 430 00000100:00080000:3.0:1787076063.627688:0:12638:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787076063.627695:0:12638:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9961b00b2000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1787076063.627718:0:12638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9961c1846680 x1873884700831104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787076063.627732:0:12638:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787076063.627735:0:12638:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787076063.627737:0:12638:0:(import.c:65:import_set_state_nolock()) ffff9961bf061800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787076063.627741:0:12638:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 430 00000100:00080000:3.0:1787076063.627743:0:12638:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787076063.627746:0:12638:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9961bf061800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1787076063.627765:0:12638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9961c1845f80 x1873884700831232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787076063.627816:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700831488:0@lo:400:kworker.0 00000100:00100000:3.0:1787076063.627885:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076063.627956:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700831488 00000100:00100000:3.0:1787076063.627963:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700831488 00000100:00100000:3.0:1787076063.628016:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787076063.628023:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700831488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787076063.628085:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700831488:12345-0@lo:400:kworker.0 Request processed in 61us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076063.628093:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787076063.628124:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787076063.628153:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961c1847100 x1873884700831488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787076079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787076063.628165:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700831488:0@lo:400:kworker.0 00000100:00100000:0.0:1787076063.628798:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51646941-6761-4bd4-bf4b-97125ced6c1b:3313:1873884700830976:0@lo:400:kworker.0 00000100:00100000:0.0:1787076063.628852:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076063.628885:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787076063.628892:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700831360:0@lo:400:kworker.0 00000100:00100000:0.0:1787076063.628916:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076063.629107:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700830976 00000100:00100000:1.0:1787076063.629113:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700830976 00000100:00100000:1.0:1787076063.629160:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787076063.629169:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+16:3313:x1873884700830976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787076063.629217:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+16:3313:x1873884700830976:12345-0@lo:400:kworker.0 Request processed in 49us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076063.629225:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787076063.632228:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700831360 00000100:00100000:3.0:1787076063.632245:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700831360 00000100:00100000:3.0:1787076063.632321:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787076063.632333:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700831360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787076063.632449:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700831360:12345-0@lo:400:kworker.0 Request processed in 117us (3530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076063.632457:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787076063.638259:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961c1847800 x1873884700831360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787076079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787076063.638281:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700831360:0@lo:400:kworker.0 00000100:00100000:1.0:1787076063.638294:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51646941-6761-4bd4-bf4b-97125ced6c1b:3313:1873884700830976:0@lo:400:kworker.0 00000100:00100000:1.0:1787076063.638338:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700831104:0@lo:8:kworker.0 00000100:00100000:1.0:1787076063.638411:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076063.638465:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700831232:0@lo:8:kworker.0 00000100:00100000:1.0:1787076063.638587:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076063.638626:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700831104 00000100:00100000:3.0:1787076063.638634:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700831104 00000100:00100000:3.0:1787076063.638680:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700831232 00000100:00100000:3.0:1787076063.638684:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700831232 00000100:00100000:3.0:1787076063.638708:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787076063.638716:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1873884700831104:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787076063.638747:0:15008:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:3.0:1787076063.638779:0:15008:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x859911ad686a068b 00002000:00100000:3.0:1787076063.638796:0:15008:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff996194069000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113901 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787076063.638800:0:15008:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787076063.638803:0:15008:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787076063.639227:0:15008:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787076063.639254:0:15008:0:(import.c:65:import_set_state_nolock()) ffff996194068800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787076063.639327:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1873884700831104:12345-0@lo:8:kworker.0 Request processed in 611us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076063.639335:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787076063.639355:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787076063.639360:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1873884700831232:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787076063.639372:0:15008:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787076063.639417:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1873884700831232:12345-0@lo:8:kworker.0 Request processed in 55us (829us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787076063.639423:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787076063.640727:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961c1846680 x1873884700831104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787076083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787076063.640743:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787076063.640754:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787076063.640766:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787076063.640773:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787076063.640776:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961b00b2000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787076063.640807:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787076063.640814:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700831104:0@lo:8:kworker.0 00000100:00080000:1.0:1787076063.640830:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961bf061800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787076063.640834:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787076063.640836:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700831232:0@lo:8:kworker.0 00000004:00080000:3.0:1787076063.640979:0:14346:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1787076063.641001:0:14346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1845c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14346:1873884700831744:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787076063.641058:0:14346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076063.641089:0:14346:0:(client.c:2702:ptlrpc_set_wait()) set ffff996191869900 going to sleep for 11 seconds 00000004:00080000:3.0:1787076063.641119:0:14345:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787076063.641230:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700831744 00000100:00100000:2.0:1787076063.641237:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700831744 00000100:00100000:2.0:1787076063.641336:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787076063.641347:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14346:x1873884700831744:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787076063.642277:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700831616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787076063.642329:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076063.642579:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700831616 00000100:00100000:1.0:1787076063.642585:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700831616 00000100:00100000:1.0:1787076063.642623:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787076063.642630:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1873884700831616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787076063.642681:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787076063.642728:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1873884700831616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076063.642736:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787076063.642775:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961c1847100 x1873884700831616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787076079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787076063.642809:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700831616:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1787076063.643544:0:14345:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 445618901952ns, next at 0ns, rc = 0 00002000:00080000:2.0:1787076063.651242:0:15006:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787076063.651256:0:15006:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787076063.651261:0:15006:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00080000:0.0:1787076063.651433:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1787076063.674299:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787076063.674313:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a0692 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.674333:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1787076063.674338:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787076063.674352:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a0692 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.674374:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a0692 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.674385:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a0692 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.674393:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a0692 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.674417:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787076063.674433:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076063.674439:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a0692 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.674448:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840600 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076063.674453:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a0692 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.674464:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a0692 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.674497:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a0692 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.674516:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a0692 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.674533:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.674535:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.674538:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787076063.675297:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787076063.675304:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a0699 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.675316:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1787076063.675319:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787076063.675324:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a0699 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.675334:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a0699 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.675343:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a0699 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.675352:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a0699 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.675369:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787076063.675379:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076063.675392:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a0699 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.675400:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841800 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076063.675405:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a0699 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.675414:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a0699 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.675428:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a0699 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.675435:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a0699 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.675450:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.675451:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.675453:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787076063.676899:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787076063.676910:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4f63d3b/0x859911ad686a06a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.676924:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1787076063.676928:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787076063.676933:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4f63d3b/0x859911ad686a06a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.676956:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4f63d3b/0x859911ad686a06a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.676965:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4f63d3b/0x859911ad686a06a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.676972:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4f63d3b/0x859911ad686a06a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.676993:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787076063.677006:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076063.677012:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4f63d3b/0x859911ad686a06a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.677020:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841c00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076063.677025:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4f63d3b/0x859911ad686a06a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.677034:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4f63d3b/0x859911ad686a06a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.677046:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4f63d3b/0x859911ad686a06a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.677054:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4f63d3b/0x859911ad686a06a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.677752:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.677755:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.677757:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787076063.681321:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787076063.681335:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bc4171c/0x859911ad686a06a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.681352:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1787076063.681357:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787076063.681364:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bc4171c/0x859911ad686a06a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.681378:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bc4171c/0x859911ad686a06a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.681389:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bc4171c/0x859911ad686a06a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.681396:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bc4171c/0x859911ad686a06a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.681414:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787076063.681425:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076063.681430:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bc4171c/0x859911ad686a06a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.681453:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840000 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076063.681457:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bc4171c/0x859911ad686a06a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.681467:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bc4171c/0x859911ad686a06a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.681496:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bc4171c/0x859911ad686a06a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.681503:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bc4171c/0x859911ad686a06a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.681522:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.681524:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.681525:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787076063.686841:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787076063.686855:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004166b33a/0x859911ad686a06ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.686875:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1787076063.686880:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787076063.686887:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004166b33a/0x859911ad686a06ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.686902:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004166b33a/0x859911ad686a06ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.686922:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004166b33a/0x859911ad686a06ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.686929:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004166b33a/0x859911ad686a06ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.687767:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076063.687775:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787076063.687778:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004166b33a/0x859911ad686a06ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.687792:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840c00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787076063.687797:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004166b33a/0x859911ad686a06ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.687808:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004166b33a/0x859911ad686a06ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.687832:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004166b33a/0x859911ad686a06ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.687840:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004166b33a/0x859911ad686a06ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.687867:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076063.687869:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076063.687871:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787076063.688440:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787076063.688447:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060b3fc4f/0x859911ad686a06b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.688459:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1787076063.688462:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787076063.688467:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060b3fc4f/0x859911ad686a06b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.688493:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060b3fc4f/0x859911ad686a06b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.688502:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060b3fc4f/0x859911ad686a06b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.688509:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060b3fc4f/0x859911ad686a06b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.688536:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787076063.688547:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076063.688551:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060b3fc4f/0x859911ad686a06b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.688558:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840a00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076063.688562:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060b3fc4f/0x859911ad686a06b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.688571:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060b3fc4f/0x859911ad686a06b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.688582:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060b3fc4f/0x859911ad686a06b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.688589:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060b3fc4f/0x859911ad686a06b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.688604:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.688606:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.688608:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787076063.689159:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787076063.689166:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014402ec5/0x859911ad686a06bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.689174:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1787076063.689183:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787076063.689188:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014402ec5/0x859911ad686a06bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.689199:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014402ec5/0x859911ad686a06bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.689207:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014402ec5/0x859911ad686a06bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.689214:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014402ec5/0x859911ad686a06bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.689238:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787076063.689272:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787076063.689278:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014402ec5/0x859911ad686a06bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.689287:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841000 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787076063.689298:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014402ec5/0x859911ad686a06bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.689307:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014402ec5/0x859911ad686a06bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.689319:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014402ec5/0x859911ad686a06bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.689326:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014402ec5/0x859911ad686a06bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.689343:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076063.689344:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076063.689346:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787076063.691403:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787076063.691417:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051129469/0x859911ad686a06c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.691435:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1787076063.691440:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787076063.691446:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051129469/0x859911ad686a06c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.691460:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051129469/0x859911ad686a06c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.691470:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051129469/0x859911ad686a06c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.691488:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051129469/0x859911ad686a06c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.691510:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787076063.691526:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076063.691532:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051129469/0x859911ad686a06c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.691541:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841a00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076063.691546:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051129469/0x859911ad686a06c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.691554:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051129469/0x859911ad686a06c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.691573:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051129469/0x859911ad686a06c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.691581:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051129469/0x859911ad686a06c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.691606:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.691608:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.691609:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787076063.697151:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787076063.697177:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a415b42/0x859911ad686a06ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.697197:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1787076063.697202:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787076063.697210:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a415b42/0x859911ad686a06ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.697225:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a415b42/0x859911ad686a06ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.697235:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a415b42/0x859911ad686a06ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.697243:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a415b42/0x859911ad686a06ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.697288:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787076063.697599:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787076063.697607:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.697608:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a415b42/0x859911ad686a06ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.697621:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840200 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076063.697626:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a415b42/0x859911ad686a06ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.697684:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a415b42/0x859911ad686a06ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.697716:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a415b42/0x859911ad686a06ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.697724:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a415b42/0x859911ad686a06ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.697746:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.697749:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.697752:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787076063.698051:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787076063.698059:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000221950b0/0x859911ad686a06d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.698077:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=445s v=(0 0) 00010000:00010000:3.0:1787076063.698081:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787076063.698086:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000221950b0/0x859911ad686a06d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.698109:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000221950b0/0x859911ad686a06d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.698119:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000221950b0/0x859911ad686a06d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.698126:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000221950b0/0x859911ad686a06d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.698143:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787076063.698415:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787076063.698423:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000221950b0/0x859911ad686a06d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.698433:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522800 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787076063.698438:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000221950b0/0x859911ad686a06d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.698447:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000221950b0/0x859911ad686a06d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.698463:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000221950b0/0x859911ad686a06d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.698472:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076063.698554:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076063.698558:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000221950b0/0x859911ad686a06d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.698558:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787076063.699111:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787076063.699120:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc45c4b9/0x859911ad686a06d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.699131:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=445s v=(0 0) 00010000:00010000:3.0:1787076063.699136:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787076063.699140:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc45c4b9/0x859911ad686a06d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.700316:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc45c4b9/0x859911ad686a06d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.700327:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc45c4b9/0x859911ad686a06d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.700333:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc45c4b9/0x859911ad686a06d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.700420:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787076063.701026:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787076063.701036:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a06df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.701050:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1787076063.701054:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787076063.701060:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a06df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.701072:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a06df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.701080:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a06df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.701089:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a06df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.701125:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787076063.701184:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787076063.701194:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc45c4b9/0x859911ad686a06d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.701205:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523200 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787076063.701209:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc45c4b9/0x859911ad686a06d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.701219:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc45c4b9/0x859911ad686a06d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.701237:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc45c4b9/0x859911ad686a06d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.701244:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc45c4b9/0x859911ad686a06d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.701264:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787076063.701267:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a06df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.701273:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841800 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787076063.701275:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a06df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.701296:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a06df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.701305:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a06df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.701312:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c84fc998/0x859911ad686a06df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.701339:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076063.701341:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076063.701343:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076063.701947:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787076063.702110:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787076063.702118:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a06e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.702130:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1787076063.702134:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787076063.702139:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a06e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.702149:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a06e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.702158:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a06e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.702165:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a06e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.702190:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787076063.702422:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787076063.702430:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a06e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.702439:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840600 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787076063.702443:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a06e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.702453:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a06e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.702467:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a06e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.702483:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff2d8e6f/0x859911ad686a06e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.702515:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076063.702517:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076063.702519:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787076063.708402:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787076063.708417:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a06ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.708436:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1787076063.708442:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076063.708451:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a06ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.708468:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a06ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.708478:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a06ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.708487:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a06ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.708518:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787076063.708558:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787076063.708566:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a06ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.708577:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632600 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787076063.708584:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a06ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.708595:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a06ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.708617:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a06ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.708692:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a06ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.708713:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076063.708716:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076063.708718:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787076063.709854:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787076063.709869:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a06f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.709888:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1787076063.709893:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076063.709899:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a06f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.710018:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a06f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.710028:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a06f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.710039:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a06f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.710064:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787076063.710160:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076063.710167:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a06f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.710178:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632000 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076063.710188:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a06f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.710198:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a06f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.710211:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a06f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.710220:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a06f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.710235:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.710237:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.710239:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787076063.712818:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787076063.712831:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b80741/0x859911ad686a06fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.712848:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1787076063.712852:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076063.712858:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077b80741/0x859911ad686a06fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.712871:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077b80741/0x859911ad686a06fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.712891:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b80741/0x859911ad686a06fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.712898:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077b80741/0x859911ad686a06fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.712928:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787076063.714431:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076063.714444:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077b80741/0x859911ad686a06fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.714456:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632200 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076063.714461:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b80741/0x859911ad686a06fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.714471:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b80741/0x859911ad686a06fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.714492:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077b80741/0x859911ad686a06fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.714530:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077b80741/0x859911ad686a06fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.714557:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.714559:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.714561:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787076063.720296:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787076063.720313:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0702 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.720333:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1787076063.720338:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076063.720344:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.720359:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.720369:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0702 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.720376:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0702 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.720409:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787076063.720420:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787076063.720429:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0702 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.720439:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633000 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787076063.720444:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0702 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.720454:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0702 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.720473:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0702 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.720481:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0702 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.720504:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076063.720506:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076063.720508:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787076063.720913:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787076063.720920:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000440d4c91/0x859911ad686a0709 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.720930:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1787076063.720933:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076063.720937:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000440d4c91/0x859911ad686a0709 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.720947:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000440d4c91/0x859911ad686a0709 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.720954:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000440d4c91/0x859911ad686a0709 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.720961:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000440d4c91/0x859911ad686a0709 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.720978:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787076063.720987:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787076063.720994:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000440d4c91/0x859911ad686a0709 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.721002:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632a00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787076063.721011:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000440d4c91/0x859911ad686a0709 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.721019:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000440d4c91/0x859911ad686a0709 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.721030:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000440d4c91/0x859911ad686a0709 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.721037:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000440d4c91/0x859911ad686a0709 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.721051:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076063.721053:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076063.721055:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787076063.721449:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787076063.721455:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e0f3670/0x859911ad686a0710 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.721463:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1787076063.721466:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076063.721471:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e0f3670/0x859911ad686a0710 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.721502:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e0f3670/0x859911ad686a0710 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.721509:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e0f3670/0x859911ad686a0710 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.721521:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e0f3670/0x859911ad686a0710 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.721618:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787076063.722054:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787076063.722061:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad686a0717 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.722069:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1787076063.722073:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076063.722077:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad686a0717 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.722087:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad686a0717 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.722106:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad686a0717 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.722114:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad686a0717 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.722130:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787076063.722139:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787076063.722143:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e0f3670/0x859911ad686a0710 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.722156:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633400 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787076063.722160:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e0f3670/0x859911ad686a0710 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.722169:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e0f3670/0x859911ad686a0710 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.722182:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e0f3670/0x859911ad686a0710 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.722188:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e0f3670/0x859911ad686a0710 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.722201:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787076063.722205:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad686a0717 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.722210:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633c00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787076063.722213:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad686a0717 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.722220:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad686a0717 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.722229:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad686a0717 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.722241:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc5ae16a/0x859911ad686a0717 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.722253:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076063.722255:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076063.722257:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076063.725804:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787076063.726300:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787076063.726313:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007945054d/0x859911ad686a071e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.726331:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1787076063.726335:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076063.726342:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007945054d/0x859911ad686a071e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.726355:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007945054d/0x859911ad686a071e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.726365:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007945054d/0x859911ad686a071e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.726372:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007945054d/0x859911ad686a071e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.726398:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787076063.726580:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076063.726589:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007945054d/0x859911ad686a071e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.726601:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633a00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076063.726606:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007945054d/0x859911ad686a071e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.726616:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007945054d/0x859911ad686a071e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.726740:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007945054d/0x859911ad686a071e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.726750:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007945054d/0x859911ad686a071e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.726769:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.726771:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.726772:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787076063.727919:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787076063.727938:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b641d40/0x859911ad686a0725 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.727952:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1787076063.727957:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076063.727962:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b641d40/0x859911ad686a0725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.727974:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b641d40/0x859911ad686a0725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.727982:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b641d40/0x859911ad686a0725 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.727989:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b641d40/0x859911ad686a0725 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.728016:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787076063.728749:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076063.728759:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b641d40/0x859911ad686a0725 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.728771:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633e00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076063.728776:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b641d40/0x859911ad686a0725 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.728788:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b641d40/0x859911ad686a0725 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.728808:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b641d40/0x859911ad686a0725 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.728816:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b641d40/0x859911ad686a0725 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.728835:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.728837:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.728839:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787076063.729994:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787076063.730004:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6283f4a/0x859911ad686a072c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.730019:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1787076063.730023:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076063.730028:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6283f4a/0x859911ad686a072c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.730040:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6283f4a/0x859911ad686a072c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.730058:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6283f4a/0x859911ad686a072c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.730065:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6283f4a/0x859911ad686a072c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.730524:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787076063.731007:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787076063.731014:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0733 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.731027:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1787076063.731032:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076063.731036:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0733 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.731046:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0733 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.731054:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0733 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.731061:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0733 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.741414:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787076063.741432:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6283f4a/0x859911ad686a072c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.741447:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633800 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076063.741452:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6283f4a/0x859911ad686a072c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.741798:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6283f4a/0x859911ad686a072c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.741824:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6283f4a/0x859911ad686a072c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.741832:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6283f4a/0x859911ad686a072c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.741860:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076063.741864:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0733 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.741870:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf633000 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076063.741874:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0733 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.741881:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0733 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.741891:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0733 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.741897:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.741899:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076063.741907:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076063.745727:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076063.745759:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787076063.745771:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000642d3448/0x859911ad686a0733 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787076063.747066:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787076063.747078:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a073a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.747114:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1787076063.747120:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076063.747127:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a073a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.747141:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a073a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.747161:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a073a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.747169:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a073a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.747243:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787076063.747733:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787076063.747739:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a0741 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.747755:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1787076063.747758:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076063.747762:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a0741 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.747771:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a0741 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.747779:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a0741 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.747785:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a0741 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.748198:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787076063.748207:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a073a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.748216:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632600 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787076063.748220:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a073a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.748230:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a073a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.748247:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a073a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.748254:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb51d3b5/0x859911ad686a073a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.748283:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787076063.748286:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a0741 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.748292:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632000 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787076063.748295:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a0741 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.748302:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a0741 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.748312:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a0741 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.748318:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076063.748320:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076063.748322:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076063.748526:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787076063.748531:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000011e6bb6/0x859911ad686a0741 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787076063.749053:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787076063.749061:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027d74971/0x859911ad686a0748 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.749071:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1787076063.749075:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076063.749079:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027d74971/0x859911ad686a0748 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.749112:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027d74971/0x859911ad686a0748 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.749122:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027d74971/0x859911ad686a0748 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.749129:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027d74971/0x859911ad686a0748 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076063.749497:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787076063.750342:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076063.750352:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aa5f807/0x859911ad686a074f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.750368:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=445s v=(0 0) 00010000:00010000:0.0:1787076063.750372:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076063.750378:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aa5f807/0x859911ad686a074f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.750389:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aa5f807/0x859911ad686a074f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.750398:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aa5f807/0x859911ad686a074f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076063.750407:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aa5f807/0x859911ad686a074f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.750455:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787076063.750464:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027d74971/0x859911ad686a0748 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.750472:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190039c00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787076063.750476:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027d74971/0x859911ad686a0748 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.750496:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027d74971/0x859911ad686a0748 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787076063.753007:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1787076063.755447:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027d74971/0x859911ad686a0748 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.755465:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027d74971/0x859911ad686a0748 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.755492:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787076063.755498:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aa5f807/0x859911ad686a074f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.755506:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68600 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787076063.755510:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aa5f807/0x859911ad686a074f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.755520:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aa5f807/0x859911ad686a074f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.755532:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aa5f807/0x859911ad686a074f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076063.755540:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076063.755542:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076063.755554:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076063.755863:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076063.758955:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787076063.758971:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aa5f807/0x859911ad686a074f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076063.759379:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787076063.762087:0:15006:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1787076063.762250:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14346:x1873884700831744:12345-0@lo:5:osp-pre-0-0.0 Request processed in 120891us (121177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076063.762269:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787076063.762286:0:14346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1845c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14346:1873884700831744:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787076063.762306:0:14346:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1787076063.762364:0:14346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1845c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14346:1873884700831872:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787076063.762409:0:14346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076063.762474:0:14346:0:(client.c:2702:ptlrpc_set_wait()) set ffff996181254cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787076063.762556:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700831872 00000100:00100000:1.0:1787076063.762564:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700831872 00000100:00100000:1.0:1787076063.762614:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787076063.762623:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14346:x1873884700831872:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787076063.762686:0:15009:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1787076063.781626:0:14346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1845c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14346:1873884700831872:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787076063.781683:0:14346:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:3.0:1787076063.785428:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14346:x1873884700831872:12345-0@lo:5:osp-pre-0-0.0 Request processed in 22794us (23007us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787076063.785445:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787076064.714735:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787076065.109353:0:15735:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787076065.109358:0:15735:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787076065.109490:0:15735:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff996082dcd000 00000020:01000004:2.0:1787076065.109505:0:15735:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787076065.109518:0:15735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787076065.109531:0:15735:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9961ba95cd40) 00000020:00000080:2.0:1787076065.109545:0:15735:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787076065.135589:0:15735:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787076065.136014:0:15735:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787076065.137165:0:15735:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787076065.137576:0:15735:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787076065.137908:0:15735:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787076065.138339:0:15735:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 403: rc = 0 00100000:10000000:3.0:1787076065.138821:0:15735:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:3.0:1787076065.138911:0:15735:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 403: rc = 0 00100000:10000000:3.0:1787076065.139571:0:15735:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 769: rc = 0 00100000:10000000:3.0:1787076065.139965:0:15735:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:3.0:1787076065.140326:0:15735:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:3.0:1787076065.140636:0:15735:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:3.0:1787076065.141023:0:15735:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 769: rc = 0 00100000:10000000:3.0:1787076065.141344:0:15735:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 769: rc = 0 00000020:00000080:3.0:1787076065.142122:0:15735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787076065.142137:0:15735:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787076065.142154:0:15735:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x859911ad686a075d 00000020:01000004:3.0:1787076065.142162:0:15735:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787076065.142186:0:15735:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787076065.142190:0:15735:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787076065.142196:0:15735:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787076065.142292:0:15735:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787076065.142297:0:15735:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787076065.153028:0:15735:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787076065.153080:0:15735:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.150@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787076065.153086:0:15735:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787076065.153087:0:15735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787076065.153089:0:15735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787076065.153090:0:15735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787076065.153091:0:15735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787076065.153093:0:15735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787076065.153094:0:15735:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787076065.153096:0:15735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787076065.153097:0:15735:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787076065.153102:0:15735:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787076065.153104:0:15735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787076065.153105:0:15735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787076065.153107:0:15735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787076065.153108:0:15735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787076065.153109:0:15735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787076065.153110:0:15735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787076065.153111:0:15735:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787076065.153112:0:15735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787076065.153113:0:15735:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787076065.153143:0:15735:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787076065.153166:0:15735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700832000:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787076065.153332:0:15735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076065.153463:0:15735:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961a1562840 going to sleep for 11 seconds 00000100:00100000:1.0:1787076065.153561:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700832000 00000100:00100000:1.0:1787076065.153569:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700832000 00000100:00100000:1.0:1787076065.153837:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787076065.153848:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+16:15735:x1873884700832000:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787076065.153879:0:14316:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787076065.153883:0:14316:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787076065.153887:0:14316:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787076065.162051:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+16:15735:x1873884700832000:12345-0@lo:253:mount.lustre.0 Request processed in 8196us (8710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076065.162091:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787076065.162205:0:15735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700832000:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787076065.162233:0:15735:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787076065.162242:0:15735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787076065.162244:0:15735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787076065.162246:0:15735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787076065.162248:0:15735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787076065.162249:0:15735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787076065.162251:0:15735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787076065.162252:0:15735:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787076065.162254:0:15735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787076065.162255:0:15735:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787076065.162276:0:15735:0:(tgt_mount.c:101:server_register_mount()) register mount ffff996082dcd000 from lustre-OST0001 10000000:01000000:3.0:1787076065.162316:0:15735:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787076065.162319:0:15735:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787076065.162327:0:15735:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9961c1804d40 local copy 00010000:00010000:3.0:1787076065.162337:0:15735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe68200/0x859911ad686a0503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a050a expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076065.162580:0:15735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700832128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787076065.162617:0:15735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076065.162862:0:15735:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961a1562840 going to sleep for 11 seconds 00000100:00100000:1.0:1787076065.162929:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700832128 00000100:00100000:1.0:1787076065.162936:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700832128 00000100:00100000:1.0:1787076065.162987:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787076065.162997:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+16:15735:x1873884700832128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787076065.163305:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+16:15735:x1873884700832128:12345-0@lo:501:mount.lustre.0 Request processed in 309us (687us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787076065.163313:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787076065.163550:0:15735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700832128:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787076065.163567:0:15735:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787076065.163833:0:15735:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787076065.163841:0:15735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961bfe68200/0x859911ad686a0503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a050a expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076065.163851:0:15735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961bfe68200/0x859911ad686a0503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a050a expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787076065.163876:0:15735:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff996082dcd000 10000000:01000000:3.0:1787076065.163881:0:15735:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787076065.163886:0:15735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787076065.163896:0:15735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787076065.163900:0:15735:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787076065.163904:0:15735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787076065.163928:0:15735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181523000/0x859911ad686a0764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076065.163937:0:15735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996181523000/0x859911ad686a0764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076065.163947:0:15735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181523000/0x859911ad686a0764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076065.163965:0:15735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700832256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787076065.163998:0:15735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076065.164021:0:15735:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961a1562840 going to sleep for 11 seconds 00000100:00100000:0.0:1787076065.164093:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700832256 00000100:00100000:0.0:1787076065.164099:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700832256 00000100:00100000:0.0:1787076065.164139:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787076065.164149:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+16:15735:x1873884700832256:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787076065.164160:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787076065.164171:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961bfe69200/0x859911ad686a076b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a0764 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076065.164194:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961bfe69200/0x859911ad686a076b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a0764 expref: 17 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076065.164203:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961bfe69200/0x859911ad686a076b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a0764 expref: 17 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076065.164224:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe69200, rc 0) 00000100:00100000:0.0:1787076065.164263:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+17:15735:x1873884700832256:12345-0@lo:101:mount.lustre.0 Request processed in 116us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076065.164269:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787076065.164396:0:15735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700832256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787076065.164408:0:15735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181523000/0x859911ad686a0764 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a076b expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076065.164417:0:15735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181523000/0x859911ad686a0764 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a076b expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787076065.166845:0:15735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787076065.171951:0:15735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787076065.172533:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787076065.172586:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787076065.172745:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787076065.172822:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787076065.172861:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787076065.172897:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787076065.172970:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787076065.172979:0:15735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787076065.173091:0:15735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700832384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787076065.173164:0:15735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076065.173203:0:15735:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961918696c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787076065.173332:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700832384 00000100:00100000:0.0:1787076065.173341:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700832384 00000100:00100000:0.0:1787076065.173392:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787076065.173402:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+17:15735:x1873884700832384:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787076065.174018:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+17:15735:x1873884700832384:12345-0@lo:501:mount.lustre.0 Request processed in 617us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076065.174027:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787076065.174421:0:15735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700832384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787076065.174525:0:15735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700832512:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787076065.174572:0:15735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076065.174666:0:15735:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961918696c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787076065.174818:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700832512 00000100:00100000:1.0:1787076065.174826:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700832512 00000100:00100000:1.0:1787076065.174900:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787076065.174910:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+17:15735:x1873884700832512:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787076065.175231:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+17:15735:x1873884700832512:12345-0@lo:503:mount.lustre.0 Request processed in 322us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076065.175239:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787076065.175317:0:15735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700832512:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787076065.176396:0:15735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787076065.176485:0:15735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700832640:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787076065.176542:0:15735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076065.177038:0:15735:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961918696c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787076065.177136:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700832640 00000100:00100000:0.0:1787076065.177151:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700832640 00000100:00100000:0.0:1787076065.177188:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787076065.177196:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+17:15735:x1873884700832640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787076065.177439:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+17:15735:x1873884700832640:12345-0@lo:502:mount.lustre.0 Request processed in 243us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076065.177447:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787076065.177670:0:15735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700832640:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787076065.177952:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787076065.178001:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787076065.178035:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787076065.178096:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787076065.178134:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787076065.178167:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787076065.178227:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787076065.178266:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787076065.178328:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787076065.178364:0:15735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700832768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787076065.178414:0:15735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076065.178723:0:15735:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961918696c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787076065.178929:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700832768 00000100:00100000:1.0:1787076065.178937:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700832768 00000100:00100000:0.0:1787076065.178992:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787076065.179003:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+17:15735:x1873884700832768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787076065.179197:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+17:15735:x1873884700832768:12345-0@lo:502:mount.lustre.0 Request processed in 195us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076065.179204:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787076065.179361:0:15735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700832768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787076065.179449:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787076065.179460:0:15735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1787076065.180508:0:15737:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787076065.180517:0:15737:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787076065.180523:0:15737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787076065.180526:0:15737:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787076065.180532:0:15737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787076065.180549:0:15737:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9961ba95b380) 00000020:00000080:2.0:1787076065.180587:0:15737:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787076065.180594:0:15737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787076065.180838:0:15737:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996082dcd000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787076065.180847:0:15737:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787076065.180854:0:15737:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x859911ad686a0779 00010000:00010000:2.0:1787076065.185611:0:15737:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1787076065.186190:0:15737:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787076065.189125:0:15737:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787076065.192350:0:15737:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787076065.192365:0:15737:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787076065.192372:0:15737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076065.192374:0:15737:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787076065.192378:0:15737:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787076065.192382:0:15737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076065.192384:0:15737:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787076065.192387:0:15737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787076065.192388:0:15737:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787076065.192390:0:15737:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787076065.192392:0:15737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076065.192394:0:15737:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787076065.192396:0:15737:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787076065.192398:0:15737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076065.192399:0:15737:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787076065.192403:0:15737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787076065.192467:0:15737:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787076065.192470:0:15737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076065.192472:0:15737:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787076065.192481:0:15737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787076065.192691:0:15735:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787076065.192720:0:15735:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787076065.192734:0:15735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181523000/0x859911ad686a0764 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a076b expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076065.192747:0:15735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181523000/0x859911ad686a0764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a076b expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787076065.192755:0:15735:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996082dcd000 from 1 10000000:01000000:2.0:1787076065.192758:0:15735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787076065.192797:0:15735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961c1841a00/0x859911ad686a0780 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076065.192805:0:15735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9961c1841a00/0x859911ad686a0780 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076065.192817:0:15735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9961c1841a00/0x859911ad686a0780 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076065.192847:0:15735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700832896:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787076065.192921:0:15735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076065.192961:0:15735:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961918699c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787076065.193177:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700832896 00000100:00100000:3.0:1787076065.193186:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700832896 00000100:00100000:3.0:1787076065.193312:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787076065.193322:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b5170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+17:15735:x1873884700832896:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787076065.193335:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787076065.193348:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181522800/0x859911ad686a0787 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a0780 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076065.193377:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181522800/0x859911ad686a0787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a0780 expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076065.193387:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181522800/0x859911ad686a0787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a0780 expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076065.193395:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522800, rc 0) 00000100:00100000:3.0:1787076065.193436:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b5170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+18:15735:x1873884700832896:12345-0@lo:101:mount.lustre.0 Request processed in 115us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076065.193443:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787076065.193537:0:15735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700832896:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787076065.193551:0:15735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9961c1841a00/0x859911ad686a0780 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0787 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076065.193566:0:15735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9961c1841a00/0x859911ad686a0780 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a0787 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787076065.194346:0:15735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787076065.194633:0:15735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787076065.195048:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787076065.195106:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787076065.195165:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787076065.195173:0:15735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787076065.195320:0:15735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700833024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787076065.195376:0:15735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076065.195419:0:15735:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961918699c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787076065.195480:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700833024 00000100:00100000:0.0:1787076065.195487:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700833024 00000100:00100000:0.0:1787076065.195581:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787076065.195592:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b5170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+18:15735:x1873884700833024:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787076065.196619:0:15735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700833024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787076065.196689:0:15735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700833152:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787076065.196737:0:15735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076065.196768:0:15735:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961918699c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787076065.196845:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700833152 00000100:00100000:1.0:1787076065.196852:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700833152 00000100:00100000:1.0:1787076065.196885:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787076065.196894:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b5173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+19:15735:x1873884700833152:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787076065.197309:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b5170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+19:15735:x1873884700833024:12345-0@lo:501:mount.lustre.0 Request processed in 418us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076065.197318:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787076065.197376:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b5173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+18:15735:x1873884700833152:12345-0@lo:503:mount.lustre.0 Request processed in 483us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076065.197383:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787076065.197508:0:15735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700833152:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787076065.198131:0:15735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787076065.198300:0:15735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700833280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787076065.198353:0:15735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076065.198396:0:15735:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961918699c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787076065.198533:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700833280 00000100:00100000:0.0:1787076065.198540:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700833280 00000100:00100000:0.0:1787076065.198616:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787076065.198626:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bbacc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+18:15735:x1873884700833280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787076065.198856:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bbacc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+18:15735:x1873884700833280:12345-0@lo:502:mount.lustre.0 Request processed in 230us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076065.198864:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787076065.199111:0:15735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700833280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787076065.199438:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787076065.199490:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787076065.199544:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787076065.199592:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787076065.199627:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787076065.199793:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787076065.199827:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787076065.199856:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787076065.199886:0:15735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700833408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787076065.199935:0:15735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076065.199964:0:15735:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961918699c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787076065.200135:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700833408 00000100:00100000:1.0:1787076065.200142:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700833408 00000100:00100000:1.0:1787076065.200180:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787076065.200189:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bab97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+18:15735:x1873884700833408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787076065.200482:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bab97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+18:15735:x1873884700833408:12345-0@lo:502:mount.lustre.0 Request processed in 293us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076065.200499:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787076065.200569:0:15735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700833408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787076065.200808:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787076065.200819:0:15735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787076065.201871:0:15741:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787076065.201881:0:15741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076065.201884:0:15741:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787076065.201892:0:15741:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff996082dcd000 00000020:00000080:0.0:1787076065.201894:0:15741:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787076065.201901:0:15741:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787076065.201904:0:15741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076065.201905:0:15741:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787076065.201907:0:15741:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787076065.201909:0:15741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076065.201910:0:15741:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787076065.201913:0:15741:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff996082dcd000 00000020:00000080:0.0:1787076065.201915:0:15741:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787076065.202115:0:15741:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787076065.202120:0:15741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076065.202128:0:15741:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787076065.202132:0:15741:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787076065.202135:0:15741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076065.202137:0:15741:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787076065.202140:0:15741:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff996082dcd000 00000020:00000080:0.0:1787076065.202142:0:15741:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787076065.202833:0:15741:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787076065.202839:0:15741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787076065.202840:0:15741:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787076065.202844:0:15741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787076065.203502:0:15735:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787076065.203540:0:15735:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787076065.203566:0:15735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961c1841a00/0x859911ad686a0780 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0787 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076065.203580:0:15735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961c1841a00/0x859911ad686a0780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0787 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787076065.203632:0:15735:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787076065.203636:0:15735:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff996082dcd000 10000000:01000000:3.0:1787076065.203658:0:15735:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff996082dcd000 10000000:01000000:3.0:1787076065.203664:0:15735:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787076065.203670:0:15735:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff996082dcd000 from 1 10000000:01000000:3.0:1787076065.203672:0:15735:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787076065.203719:0:15735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad686a078e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076065.203729:0:15735:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad686a078e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076065.203751:0:15735:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad686a078e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076065.203780:0:15735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700833536:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787076065.203861:0:15735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076065.203914:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700833536 00000100:00100000:0.0:1787076065.203922:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700833536 00000100:00100000:0.0:1787076065.203965:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787076065.203974:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bab95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+18:15735:x1873884700833536:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787076065.203987:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787076065.203999:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961bfe68a00/0x859911ad686a0795 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a078e expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076065.204022:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961bfe68a00/0x859911ad686a0795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a078e expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076065.204033:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961bfe68a00/0x859911ad686a0795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a078e expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076065.204040:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe68a00, rc 0) 00000100:00100000:3.0:1787076065.204105:0:15735:0:(client.c:2702:ptlrpc_set_wait()) set ffff99619036b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787076065.204248:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bab95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+19:15735:x1873884700833536:12345-0@lo:101:mount.lustre.0 Request processed in 274us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076065.204257:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787076065.204336:0:15735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700833536:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787076065.204349:0:15735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad686a078e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0795 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076065.204359:0:15735:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad686a078e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a0795 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787076065.205328:0:15735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787076065.206562:0:15735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787076065.207220:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787076065.207272:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787076065.207301:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787076065.207339:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787076065.207578:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787076065.207667:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787076065.207701:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787076065.207728:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787076065.207766:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787076065.207794:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787076065.207821:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787076065.207858:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787076065.207891:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787076065.207918:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787076065.207967:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787076065.207995:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787076065.208021:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787076065.208057:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787076065.208102:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787076065.208130:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787076065.208370:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787076065.208470:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787076065.208506:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787076065.208547:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787076065.208575:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787076065.208684:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787076065.208728:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787076065.208756:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787076065.208783:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787076065.208824:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1787076065.208852:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1787076065.208879:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1787076065.208906:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1787076065.208943:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1787076065.208970:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1787076065.209026:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1787076065.209078:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1787076065.209259:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1787076065.209268:0:15735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787076065.209390:0:15735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700833664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787076065.209537:0:15735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076065.209584:0:15735:0:(client.c:2702:ptlrpc_set_wait()) set ffff99619036b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787076065.210737:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700833664 00000100:00100000:3.0:1787076065.210750:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700833664 00000100:00100000:3.0:1787076065.210805:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787076065.210815:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bab97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+19:15735:x1873884700833664:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787076065.211117:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bab97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+19:15735:x1873884700833664:12345-0@lo:501:mount.lustre.0 Request processed in 302us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076065.211126:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787076065.211714:0:15735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700833664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787076065.211764:0:15735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700833792:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787076065.211809:0:15735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076065.211839:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700833792 00000100:00100000:0.0:1787076065.211845:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700833792 00000100:00100000:3.0:1787076065.211848:0:15735:0:(client.c:2702:ptlrpc_set_wait()) set ffff99619036b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787076065.211870:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787076065.211884:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bab96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+19:15735:x1873884700833792:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787076065.212831:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bab96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+19:15735:x1873884700833792:12345-0@lo:503:mount.lustre.0 Request processed in 946us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076065.212841:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787076065.213746:0:15735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700833792:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787076065.214446:0:15735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787076065.214527:0:15735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700833920:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787076065.214602:0:15735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076065.214734:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700833920 00000100:00100000:3.0:1787076065.214742:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700833920 00000100:00100000:3.0:1787076065.214783:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787076065.214793:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bab94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+19:15735:x1873884700833920:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787076065.215052:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bab94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+19:15735:x1873884700833920:12345-0@lo:502:mount.lustre.0 Request processed in 261us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076065.215060:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787076065.215120:0:15735:0:(client.c:2702:ptlrpc_set_wait()) set ffff99619036b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787076065.215137:0:15735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700833920:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787076065.215422:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787076065.215471:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787076065.215510:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787076065.215552:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787076065.215579:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787076065.215632:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787076065.215749:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787076065.215781:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787076065.215832:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787076065.215873:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787076065.215915:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787076065.215965:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787076065.216014:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787076065.216045:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787076065.216104:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787076065.216139:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787076065.216172:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787076065.216290:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787076065.216325:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787076065.216354:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787076065.216393:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787076065.216424:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787076065.216455:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787076065.216508:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787076065.216543:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787076065.216572:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787076065.216611:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787076065.216792:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787076065.216843:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787076065.216889:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787076065.216921:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787076065.216949:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787076065.216977:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787076065.217019:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787076065.217054:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787076065.217116:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787076065.217154:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787076065.217189:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787076065.217327:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787076065.217363:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787076065.217408:0:15735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700834048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787076065.217477:0:15735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076065.217522:0:15735:0:(client.c:2702:ptlrpc_set_wait()) set ffff99619036b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787076065.217608:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700834048 00000100:00100000:0.0:1787076065.217616:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700834048 00000100:00100000:3.0:1787076065.217790:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787076065.217801:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bab95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+19:15735:x1873884700834048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787076065.218014:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bab95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+19:15735:x1873884700834048:12345-0@lo:502:mount.lustre.0 Request processed in 215us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076065.218022:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787076065.218094:0:15735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700834048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787076065.218160:0:15735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787076065.218170:0:15735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787076065.224499:0:15746:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787076065.224518:0:15746:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9961c18019c0) 00000020:00000080:1.0:1787076065.224539:0:15746:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787076065.224710:0:15746:0:(tgt_mount.c:153:server_get_mount()) get mount ffff996082dcd000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787076065.224715:0:15746:0:(tgt_mount.c:187:server_put_mount()) put mount ffff996082dcd000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787076065.224718:0:15746:0:(obd_mount.c:710:lustre_put_lsi()) put ffff996082dcd000 3 00010000:00080000:1.0:1787076065.224751:0:15746:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99608269b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.150@tcp at head 00010000:00010000:1.0:1787076065.228303:0:15746:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787076065.228414:0:15746:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787076065.228761:0:15746:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787076065.228775:0:15746:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x859911ad686a07a3 00000100:00080000:1.0:1787076065.228788:0:15746:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787076065.228794:0:15746:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99608269b000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:1.0:1787076065.228830:0:15746:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9961b52e6a00 x1873884700834176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787076065.228887:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1873884700834176:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787076065.228955:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787076065.229019:0:15746:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787076065.229185:0:12638:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787076065.229189:0:12638:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787076065.229192:0:12638:0:(import.c:65:import_set_state_nolock()) ffff9961bf061800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787076065.229197:0:12638:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 445 00000100:00080000:0.0:1787076065.229201:0:12638:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787076065.229206:0:12638:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9961bf061800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:2.0:1787076065.229252:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700834176 00000100:00100000:2.0:1787076065.229260:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700834176 00000100:00100000:2.0:1787076065.229291:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787076065.229298:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1873884700834176:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787076065.229308:0:12638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996184e8dc00 x1873884700834432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:2.0:1787076065.229319:0:14323:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:2.0:1787076065.229354:0:14323:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x859911ad686a07aa 00000100:00100000:0.0:1787076065.229357:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700834304:0@lo:400:kworker.0 00000004:00100000:2.0:1787076065.229369:0:14323:0:(mdt_handler.c:7351:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1787076065.229389:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787076065.229396:0:14323:0:(import.c:65:import_set_state_nolock()) ffff996083414000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787076065.229411:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787076065.229416:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700834560:0@lo:400:kworker.0 00000040:00080000:1.0:1787076065.229958:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787076065.230103:0:15735:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787076065.230138:0:15735:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787076065.230157:0:15735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad686a078e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0795 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076065.230169:0:15735:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996181522c00/0x859911ad686a078e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0795 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787076065.230223:0:15735:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787076065.230226:0:15735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787076065.230227:0:15735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787076065.230228:0:15735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787076065.230229:0:15735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787076065.230231:0:15735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787076065.230232:0:15735:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787076065.230234:0:15735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787076065.230236:0:15735:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787076065.230248:0:15735:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787076065.230252:0:15735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787076065.230254:0:15735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787076065.230255:0:15735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787076065.230256:0:15735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787076065.230256:0:15735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787076065.230257:0:15735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787076065.230258:0:15735:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787076065.230259:0:15735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787076065.230260:0:15735:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787076065.230276:0:15735:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787076065.230290:0:15735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700834816:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787076065.230392:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076065.230394:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873884700834176:12345-0@lo:38:llog_process_th.0 Request processed in 1095us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076065.230404:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787076065.230421:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700834560 00000100:00100000:0.0:1787076065.230435:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700834688:0@lo:400:kworker.0 00000100:00100000:0.0:1787076065.230461:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076065.230494:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700834304 00000100:00100000:0.0:1787076065.230498:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700834304 00000100:00100000:1.0:1787076065.230512:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700834688 00000100:00100000:1.0:1787076065.230516:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700834688 00000100:00100000:1.0:1787076065.230537:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787076065.230540:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787076065.230543:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700834688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787076065.230545:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1873884700834304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787076065.230582:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700834688:12345-0@lo:400:kworker.0 Request processed in 38us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076065.230582:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1873884700834304:12345-0@lo:400:kworker.0 Request processed in 36us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076065.230588:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787076065.230594:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787076065.230621:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700834560 00000100:00080000:0.0:1787076065.230625:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787076065.230630:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787076065.230831:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996184e8c380 x1873884700834688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787076081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787076065.230843:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700834688:0@lo:400:kworker.0 00000100:00100000:0.0:1787076065.230868:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700834304:0@lo:400:kworker.0 00000100:00100000:2.0:1787076065.230910:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787076065.230917:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700834560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787076065.230958:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700834560:12345-0@lo:400:kworker.0 Request processed in 43us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076065.230965:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787076065.230989:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700834432:0@lo:8:kworker.0 00000100:00100000:2.0:1787076065.231013:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787076065.231039:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9961b52e6a00 x1873884700834176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787076075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787076065.231048:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787076065.231054:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787076065.231061:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787076065.231078:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787076065.231081:0:3310:0:(import.c:65:import_set_state_nolock()) ffff99608269b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787076065.231087:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1873884700834176:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787076065.231109:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700834432 00000100:00100000:2.0:1787076065.231114:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700834432 00000100:00100000:2.0:1787076065.231132:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787076065.231137:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1873884700834432:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787076065.231302:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1873884700834432:12345-0@lo:8:kworker.0 Request processed in 162us (286us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787076065.231308:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787076065.231331:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787076065.231336:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961bf061800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787076065.231339:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787076065.231342:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700834432:0@lo:8:kworker.0 00010000:00080000:2.0:1787076065.231365:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff996184e8f480 x1873884700834560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787076081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787076065.231379:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700834560:0@lo:400:kworker.0 00000100:00100000:3.0:1787076065.231577:0:15735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076065.231610:0:15735:0:(client.c:2702:ptlrpc_set_wait()) set ffff99619036b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787076065.231715:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700834816 00000100:00100000:2.0:1787076065.231720:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700834816 00000100:00100000:2.0:1787076065.231747:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787076065.231755:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bab97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+19:15735:x1873884700834816:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787076065.231773:0:14317:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787076065.231787:0:14317:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787076065.258460:0:14317:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787076065.258478:0:14317:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787076065.258516:0:14339:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787076065.258522:0:14339:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787076065.258548:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9961bfe69000/0x859911ad686a07b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076065.258570:0:14339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9961bf633200/0x859911ad686a0684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a067d expref: 19 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076065.258579:0:14339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9961bfe69000/0x859911ad686a07b1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076065.258626:0:14339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9961bf633200/0x859911ad686a0684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad686a067d expref: 19 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076065.258754:0:14339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9961bf633200/0x859911ad686a0684 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad686a067d expref: 19 pid: 14316 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076065.258775:0:14339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14339:1873884700834944:0@lo:104: 00000100:00100000:0.0:1787076065.258852:0:14339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076065.258906:0:14339:0:(client.c:2702:ptlrpc_set_wait()) set ffff996188d6a300 going to sleep for 11 seconds 00000100:00100000:0.0:1787076065.258926:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700834944 00000100:00100000:0.0:1787076065.258933:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700834944 00000100:00100000:0.0:1787076065.258979:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787076065.258989:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51646941-6761-4bd4-bf4b-97125ced6c1b+3:14339:x1873884700834944:12345-0@lo:104: 00010000:00010000:0.0:1787076065.259001:0:14307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9961bfe68000/0x859911ad686a067d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad686a0684 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076065.259055:0:14307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787076065.259061:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51646941-6761-4bd4-bf4b-97125ced6c1b+3:14339:x1873884700834944:12345-0@lo:104: Request processed in 74us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076065.259079:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787076065.259101:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787076065.259106:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9961bfe68000/0x859911ad686a067d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad686a0684 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076065.259114:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68000 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:0.0:1787076065.259118:0:14313:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9961bfe68000/0x859911ad686a067d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad686a0684 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076065.259125:0:14313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9961bfe68000/0x859911ad686a067d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad686a0684 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787076065.259132:0:14313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9961bfe68000/0x859911ad686a067d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad686a0684 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787076065.259137:0:14313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787076065.259165:0:14313:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9961bfe68000/0x859911ad686a067d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a0684 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076065.259171:0:14313:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787076065.259198:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9961bfe68000/0x859911ad686a067d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a0684 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076065.259205:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9961bfe68000/0x859911ad686a067d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a0684 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076065.259402:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076065.259405:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076065.259407:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787076065.259420:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51646941-6761-4bd4-bf4b-97125ced6c1b:3312:1873884700835072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787076065.259450:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076065.259619:0:14339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14339:1873884700834944:0@lo:104: 00010000:00010000:0.0:1787076065.259679:0:14339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9961bfe69000/0x859911ad686a07b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076065.260444:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700835072 00000100:00100000:1.0:1787076065.260453:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700835072 00010000:00010000:1.0:1787076065.260491:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9961bf633200/0x859911ad686a0684 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad686a067d expref: 20 pid: 14316 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076065.260566:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787076065.260575:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51646941-6761-4bd4-bf4b-97125ced6c1b+20:3312:x1873884700835072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787076065.260589:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787076065.260594:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9961bf633200/0x859911ad686a0684 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad686a067d expref: 20 pid: 14316 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076065.260605:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9961bf633200/0x859911ad686a0684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad686a067d expref: 20 pid: 14316 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076065.260620:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961bf633200/0x859911ad686a0684 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad686a067d expref: 20 pid: 14316 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076065.260633:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9961bfe69000/0x859911ad686a07b1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076065.260669:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961bfe69000/0x859911ad686a07b1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787076065.260791:0:14311:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002270266s 00010000:00010000:1.0:1787076065.260796:0:14311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9961bfe69000/0x859911ad686a07b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076065.260803:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9961bfe69000/0x859911ad686a07b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076065.260810:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9961bfe69000/0x859911ad686a07b1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076065.260816:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9961bfe69000/0x859911ad686a07b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076065.260828:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69000 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787076065.260833:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9961bfe69000/0x859911ad686a07b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076065.260840:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9961bfe69000/0x859911ad686a07b1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076065.260858:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9961bfe69000/0x859911ad686a07b1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076065.260867:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787076065.260910:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51646941-6761-4bd4-bf4b-97125ced6c1b+19:3312:x1873884700835072:12345-0@lo:103:ldlm_bl.0 Request processed in 337us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076065.260918:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787076065.260972:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51646941-6761-4bd4-bf4b-97125ced6c1b:3312:1873884700835072:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787076065.260996:0:14339:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9961bfe69000/0x859911ad686a07b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076065.261004:0:14339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9961bfe69000/0x859911ad686a07b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076065.261011:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961bfe69000/0x859911ad686a07b1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076065.265974:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bab97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+18:15735:x1873884700834816:12345-0@lo:253:mount.lustre.0 Request processed in 34207us (34384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076065.265993:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787076065.266094:0:15735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51646941-6761-4bd4-bf4b-97125ced6c1b:15735:1873884700834816:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787076065.266111:0:15735:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787076065.266114:0:15735:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787076065.266116:0:15735:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787076065.266118:0:15735:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787076065.266119:0:15735:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787076065.266120:0:15735:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787076065.266121:0:15735:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787076065.266122:0:15735:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787076065.266124:0:15735:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787076065.266126:0:15735:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787076065.266141:0:15735:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787076065.271880:0:15735:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787076065.272102:0:15735:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787076065.272339:0:15735:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787076065.272466:0:15735:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787076065.272582:0:15735:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787076065.272866:0:15735:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787076065.273534:0:15735:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787076065.337929:0:15735:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787076065.337938:0:15735:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787076065.337970:0:15735:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787076065.338558:0:15735:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.150@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787076065.338675:0:15735:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787076065.338870:0:15735:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787076065.738239:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787076066.098039:0:6728:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787076066.098302:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787076066.770112:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787076066.887765:0:14321:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787076066.887774:0:14321:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9961893b3000 from 8 10000000:01000000:1.0:1787076066.887779:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787076066.887837:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad686a07b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076066.887858:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad686a07b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076066.887869:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad686a07b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076066.887900:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700835200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787076066.887982:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076066.888081:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff99619036b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787076066.888159:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700835200 00000100:00100000:0.0:1787076066.888167:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700835200 00000100:00100000:0.0:1787076066.888216:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787076066.888224:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+18:14321:x1873884700835200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787076066.888237:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787076066.888252:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961bfe68400/0x859911ad686a07bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a07b8 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076066.888275:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961bfe68400/0x859911ad686a07bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a07b8 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076066.888286:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961bfe68400/0x859911ad686a07bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a07b8 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076066.888295:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961bfe68400, rc 0) 00000100:00100000:0.0:1787076066.888342:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+19:14321:x1873884700835200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076066.888349:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787076066.888440:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700835200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787076066.888467:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad686a07b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a07bf expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076066.888476:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad686a07b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a07bf expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076066.888526:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700835328:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787076066.888557:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076066.888579:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff99619036b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787076066.888807:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700835328 00000100:00100000:0.0:1787076066.888813:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700835328 00000100:00100000:0.0:1787076066.888845:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787076066.888853:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+19:14321:x1873884700835328:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787076066.888867:0:14317:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787076066.888885:0:14317:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787076066.888889:0:14317:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787076066.888976:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+19:14321:x1873884700835328:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076066.888982:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787076066.889069:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700835328:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787076066.889123:0:14321:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787076066.889131:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad686a07b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a07bf expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076066.889139:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996190038800/0x859911ad686a07b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a07bf expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076067.784097:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076068.809710:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787076069.064111:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700835456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787076069.064215:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076069.064482:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700835456 00000100:00100000:1.0:1787076069.064568:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700835456 00000100:00100000:1.0:1787076069.064693:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787076069.064704:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700835456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787076069.064739:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787076069.064794:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700835456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076069.064818:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787076069.064911:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787076069.064932:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700835456:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787076069.065087:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787076069.832027:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787076070.223277:0:14356:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1787076070.599825:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787076070.599832:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787076070.599837:0:8:0:(import.c:65:import_set_state_nolock()) ffff9961bf061800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787076070.599853:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9961bf061800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:0.0:1787076070.599880:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff996184e8c000 x1873884700835840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787076070.600026:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:51646941-6761-4bd4-bf4b-97125ced6c1b:3314:1873884700835584:0@lo:400:kworker.0 00000100:00100000:1.0:1787076070.600115:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076070.600210:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700835584 00000100:00100000:1.0:1787076070.600221:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700835584 00000100:00100000:1.0:1787076070.600281:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787076070.600291:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+19:3314:x1873884700835584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787076070.600353:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+19:3314:x1873884700835584:12345-0@lo:400:kworker.0 Request processed in 63us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076070.600360:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787076070.600442:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:51646941-6761-4bd4-bf4b-97125ced6c1b:3314:1873884700835584:0@lo:400:kworker.0 00000100:00100000:1.0:1787076070.600511:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700835712:0@lo:400:kworker.0 00000100:00100000:1.0:1787076070.600544:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076070.600584:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700835712 00000100:00100000:1.0:1787076070.600589:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700835712 00000100:00100000:1.0:1787076070.600617:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787076070.600624:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700835712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787076070.600691:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700835712:12345-0@lo:400:kworker.0 Request processed in 68us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076070.600698:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787076070.600728:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700835712:0@lo:400:kworker.0 00000100:00100000:1.0:1787076070.601106:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700835840:0@lo:8:kworker.0 00000100:00100000:1.0:1787076070.601138:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076070.601193:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700835968:0@lo:400:kworker.0 00000100:00100000:1.0:1787076070.601224:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076070.601257:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700835968 00000100:00100000:1.0:1787076070.601261:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700835968 00000100:00100000:1.0:1787076070.601295:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787076070.601302:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700835968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787076070.601348:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873884700835968:12345-0@lo:400:kworker.0 Request processed in 45us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076070.601354:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787076070.601376:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700836096:0@lo:400:kworker.0 00000100:00100000:1.0:1787076070.601411:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076070.601434:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787076070.601440:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700836224:0@lo:400:kworker.0 00000100:00100000:1.0:1787076070.601487:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076070.601535:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700836096 00000100:00100000:1.0:1787076070.601539:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700836096 00000100:00100000:1.0:1787076070.601579:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700836224 00000100:00100000:1.0:1787076070.601582:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700836224 00000100:00100000:1.0:1787076070.601604:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787076070.601610:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700836096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787076070.601678:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700836096:12345-0@lo:400:kworker.0 Request processed in 67us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076070.601685:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787076070.601701:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787076070.601707:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700836224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787076070.601735:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700836224:12345-0@lo:400:kworker.0 Request processed in 29us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076070.601751:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787076070.601772:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787076070.601801:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996184e8c700 x1873884700835968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787076086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787076070.601814:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873884700835968:0@lo:400:kworker.0 00010000:00080000:1.0:1787076070.601845:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996184e8f800 x1873884700836224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787076086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787076070.601854:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700836224:0@lo:400:kworker.0 00010000:00080000:1.0:1787076070.601865:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996184e8d180 x1873884700836096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787076086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787076070.601873:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700836096:0@lo:400:kworker.0 00000100:00100000:0.0:1787076070.602285:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700835840 00000100:00100000:0.0:1787076070.602291:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700835840 00000100:00100000:0.0:1787076070.602329:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787076070.602336:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1873884700835840:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787076070.602367:0:15006:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:0.0:1787076070.602401:0:15006:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x859911ad686a07c6 00002000:00100000:0.0:1787076070.602418:0:15006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9961c14de800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113901 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787076070.602424:0:15006:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787076070.602439:0:15006:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787076070.602843:0:15006:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787076070.602873:0:15006:0:(import.c:65:import_set_state_nolock()) ffff9961c14d9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787076070.603185:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1873884700835840:12345-0@lo:8:kworker.0 Request processed in 847us (2045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076070.603195:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787076070.604252:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996184e8c000 x1873884700835840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787076095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787076070.604272:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787076070.604281:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787076070.604287:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787076070.604290:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9961bf061800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787076070.604329:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787076070.604335:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1873884700835840:0@lo:8:kworker.0 00000100:00100000:1.0:1787076070.604666:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787076070.604681:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700836352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787076070.604733:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076070.604776:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700836352 00000100:00100000:1.0:1787076070.604792:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700836352 00000100:00100000:1.0:1787076070.604843:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787076070.604860:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1873884700836352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787076070.604973:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787076070.605020:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1873884700836352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076070.605027:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787076070.605050:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787076070.605073:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff996184e8ce00 x1873884700836352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787076086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787076070.605088:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700836352:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1787076070.605479:0:14347:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787076070.606184:0:14347:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 452581542517ns, next at 0ns, rc = 0 00000004:00080000:1.0:1787076070.606332:0:14348:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1787076070.606384:0:14348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14348:1873884700836480:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787076070.606706:0:14348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076070.606739:0:14348:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961a0395c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787076070.606835:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700836480 00000100:00100000:2.0:1787076070.606844:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700836480 00000100:00100000:2.0:1787076070.606906:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787076070.606915:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14348:x1873884700836480:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787076070.609553:0:15009:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787076070.609563:0:15009:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1787076070.609569:0:15009:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1787076070.641405:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.641424:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad686a07cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.641459:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.641464:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.641612:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad686a07cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.641636:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad686a07cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.641664:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad686a07cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.641671:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad686a07cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.641698:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787076070.642298:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787076070.642309:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad686a07cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.642320:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68600 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787076070.642325:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad686a07cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.642335:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad686a07cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.642356:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad686a07cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.642363:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005aa5f807/0x859911ad686a07cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.642391:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.642393:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.642394:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787076070.647412:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.647430:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000848e0c16/0x859911ad686a07d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.647449:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.647454:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.647461:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000848e0c16/0x859911ad686a07d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.647490:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000848e0c16/0x859911ad686a07d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.648617:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000848e0c16/0x859911ad686a07d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.648627:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000848e0c16/0x859911ad686a07d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.648678:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787076070.648701:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787076070.648706:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000848e0c16/0x859911ad686a07d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.648715:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69400 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787076070.648720:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000848e0c16/0x859911ad686a07d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.648729:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000848e0c16/0x859911ad686a07d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.648747:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000848e0c16/0x859911ad686a07d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.648755:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000848e0c16/0x859911ad686a07d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.648777:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076070.648787:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076070.648789:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787076070.653781:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.653799:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ecd0b4b/0x859911ad686a07db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.653820:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.653826:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.653833:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ecd0b4b/0x859911ad686a07db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.653849:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ecd0b4b/0x859911ad686a07db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.653860:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ecd0b4b/0x859911ad686a07db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.653868:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ecd0b4b/0x859911ad686a07db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.654016:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787076070.655840:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787076070.655853:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ecd0b4b/0x859911ad686a07db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.655870:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69c00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787076070.655876:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ecd0b4b/0x859911ad686a07db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.656669:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ecd0b4b/0x859911ad686a07db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.656692:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ecd0b4b/0x859911ad686a07db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.656701:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ecd0b4b/0x859911ad686a07db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.656723:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.656725:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.656727:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787076070.656857:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.656865:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad686a07e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.656880:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.656885:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.656893:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad686a07e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.656915:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad686a07e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.656925:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad686a07e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.656933:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad686a07e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.656949:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787076070.656974:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787076070.656979:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad686a07e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.656987:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68c00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787076070.656991:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad686a07e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.657002:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad686a07e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.657014:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad686a07e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.657022:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002c6ff71/0x859911ad686a07e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.657040:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076070.657042:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076070.657044:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787076070.660016:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.660030:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbd2d64a/0x859911ad686a07e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.660048:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.660053:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.660060:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbd2d64a/0x859911ad686a07e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.660073:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbd2d64a/0x859911ad686a07e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.660083:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbd2d64a/0x859911ad686a07e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.660092:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbd2d64a/0x859911ad686a07e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.660116:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787076070.660126:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787076070.660134:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbd2d64a/0x859911ad686a07e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.660143:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe68000 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787076070.660149:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbd2d64a/0x859911ad686a07e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.660159:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbd2d64a/0x859911ad686a07e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.660189:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbd2d64a/0x859911ad686a07e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.660209:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbd2d64a/0x859911ad686a07e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.660234:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.660237:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.660239:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787076070.667937:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.667956:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575263f1/0x859911ad686a07f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.667999:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.668004:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.668011:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575263f1/0x859911ad686a07f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.668026:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000575263f1/0x859911ad686a07f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.668037:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000575263f1/0x859911ad686a07f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.668044:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000575263f1/0x859911ad686a07f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.668061:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787076070.668075:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787076070.668080:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000575263f1/0x859911ad686a07f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.668088:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bfe69000 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787076070.668092:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000575263f1/0x859911ad686a07f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.668101:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000575263f1/0x859911ad686a07f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.668133:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000575263f1/0x859911ad686a07f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.668142:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575263f1/0x859911ad686a07f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.668160:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076070.668162:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076070.668164:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787076070.671895:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.671908:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a07f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.671926:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.671931:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.671937:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a07f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.671951:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a07f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.671970:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a07f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.671980:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a07f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.672018:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787076070.672475:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.672481:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a07fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.672491:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.672494:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.672498:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a07fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.672509:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a07fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.672517:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a07fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.672525:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a07fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.672540:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787076070.672551:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787076070.672557:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a07f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.672566:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125ce00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787076070.672577:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a07f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.672587:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a07f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.672606:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a07f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.672615:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a07f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.672636:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787076070.672660:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a07fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.672667:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125d400 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787076070.672671:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a07fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.672679:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a07fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.672689:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a07fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.672697:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a07fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.672715:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076070.672717:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076070.672719:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.673100:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787076070.674747:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.674760:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a0805 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.674778:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.674782:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.674799:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a0805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.674813:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a0805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.674823:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a0805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.674831:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a0805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.674847:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787076070.674858:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787076070.674863:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a0805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.674884:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125de00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787076070.674889:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a0805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.674900:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a0805 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.674917:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a0805 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.674926:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a0805 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.674948:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076070.674951:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076070.674953:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787076070.685622:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1787076070.686936:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.687428:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a080c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.687506:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.687511:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.687518:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a080c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.687546:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a080c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.687558:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a080c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.687566:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a080c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.687593:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787076070.688205:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787076070.688207:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787076070.688213:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a0813 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.688217:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a080c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.688224:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.688230:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.688240:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a0813 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.688245:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125de00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076070.688252:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a080c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.688256:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a0813 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.688266:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a0813 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.688283:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a0813 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.688296:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787076070.688306:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1787076070.688756:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.688762:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a081a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.688771:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.688774:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.688779:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a081a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.688788:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a081a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.688796:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a081a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.688803:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a081a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.688810:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787076070.689235:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.689246:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0821 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.689254:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.689258:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.689262:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.689271:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.689280:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0821 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.689287:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.689295:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787076070.689696:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.689703:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0828 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.689712:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.689715:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.689720:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.689728:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.689741:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.689747:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.689755:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787076070.691161:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a080c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691192:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a080c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691201:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081d4f77a/0x859911ad686a080c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691227:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787076070.691231:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a081a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691239:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125ce00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076070.691243:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a081a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691251:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a081a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691284:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a081a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691301:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000743e641b/0x859911ad686a081a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691317:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787076070.691322:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691329:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125d800 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076070.691333:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0821 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691341:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0821 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691354:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0821 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691362:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0821 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691376:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076070.691380:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691387:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125ca00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076070.691397:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691405:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0828 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691416:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0828 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691424:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0828 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691442:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076070.691444:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076070.691447:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076070.691532:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076070.691538:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a0813 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691546:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125d400 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076070.691549:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a0813 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691556:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a0813 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691566:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a0813 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691580:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070c83a35/0x859911ad686a0813 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.691595:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076070.691597:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076070.691599:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076070.691603:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076070.691605:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787076070.692327:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1787076070.694271:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.694283:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f74d2df/0x859911ad686a082f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.694300:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.694304:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.694311:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f74d2df/0x859911ad686a082f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.694326:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f74d2df/0x859911ad686a082f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.694335:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f74d2df/0x859911ad686a082f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.694342:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f74d2df/0x859911ad686a082f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.694373:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787076070.694558:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076070.694566:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f74d2df/0x859911ad686a082f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.694576:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125c200 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076070.694582:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f74d2df/0x859911ad686a082f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.694591:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f74d2df/0x859911ad686a082f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.694610:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f74d2df/0x859911ad686a082f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.694619:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f74d2df/0x859911ad686a082f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.694666:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076070.694674:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076070.694676:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787076070.694862:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.694869:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0836 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.694879:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.694882:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.694886:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0836 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.694897:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0836 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.694906:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0836 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.694913:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0836 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.694939:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787076070.695323:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.695330:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000649681a8/0x859911ad686a083d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.695338:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.695347:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.695352:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000649681a8/0x859911ad686a083d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.695361:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000649681a8/0x859911ad686a083d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.695370:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000649681a8/0x859911ad686a083d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.695377:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000649681a8/0x859911ad686a083d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.695390:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787076070.695733:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787076070.695740:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0836 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.695749:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125da00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076070.695753:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0836 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.695761:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0836 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.695773:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0836 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.695780:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0836 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.695796:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787076070.695799:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000649681a8/0x859911ad686a083d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.695804:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125d000 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076070.695806:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000649681a8/0x859911ad686a083d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.695825:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000649681a8/0x859911ad686a083d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.695835:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000649681a8/0x859911ad686a083d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.695842:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000649681a8/0x859911ad686a083d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076070.695852:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076070.695853:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076070.695854:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787076070.695879:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787076070.698451:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.698464:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffe2a5b8/0x859911ad686a0844 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.698482:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.698487:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.698493:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffe2a5b8/0x859911ad686a0844 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.698507:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffe2a5b8/0x859911ad686a0844 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.698518:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffe2a5b8/0x859911ad686a0844 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.698533:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffe2a5b8/0x859911ad686a0844 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.703216:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787076070.703768:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787076070.703778:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffe2a5b8/0x859911ad686a0844 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.703792:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125d200 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787076070.703797:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffe2a5b8/0x859911ad686a0844 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.703808:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffe2a5b8/0x859911ad686a0844 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.703832:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffe2a5b8/0x859911ad686a0844 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.703839:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffe2a5b8/0x859911ad686a0844 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.703862:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.703864:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.703872:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787076070.703887:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.703895:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000060e5d16/0x859911ad686a084b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.703909:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.703914:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.703920:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000060e5d16/0x859911ad686a084b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.703932:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000060e5d16/0x859911ad686a084b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.703941:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000060e5d16/0x859911ad686a084b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.703949:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000060e5d16/0x859911ad686a084b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.703985:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787076070.704308:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787076070.704314:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000060e5d16/0x859911ad686a084b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.704323:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125c600 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787076070.704327:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000060e5d16/0x859911ad686a084b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.704335:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000060e5d16/0x859911ad686a084b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.704347:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000060e5d16/0x859911ad686a084b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.704355:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000060e5d16/0x859911ad686a084b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.704370:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.704372:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.704374:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787076070.704387:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.704394:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000772e667e/0x859911ad686a0852 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.704408:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.704411:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.704416:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000772e667e/0x859911ad686a0852 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.704426:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000772e667e/0x859911ad686a0852 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.704435:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000772e667e/0x859911ad686a0852 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.704443:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000772e667e/0x859911ad686a0852 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.704467:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787076070.704676:0:16041:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787076070.704682:0:16041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000772e667e/0x859911ad686a0852 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.704690:0:16041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125c400 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787076070.704693:0:16041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000772e667e/0x859911ad686a0852 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.704713:0:16041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000772e667e/0x859911ad686a0852 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.704723:0:16041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000772e667e/0x859911ad686a0852 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.704730:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000772e667e/0x859911ad686a0852 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.704742:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.704743:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.704745:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787076070.704914:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.704919:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000152eb6bb/0x859911ad686a0859 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.704928:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.704931:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.704935:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000152eb6bb/0x859911ad686a0859 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.704945:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000152eb6bb/0x859911ad686a0859 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.704975:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000152eb6bb/0x859911ad686a0859 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.704983:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000152eb6bb/0x859911ad686a0859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.705004:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787076070.705264:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787076070.705270:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000152eb6bb/0x859911ad686a0859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.705278:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125c000 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787076070.705282:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000152eb6bb/0x859911ad686a0859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.705290:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000152eb6bb/0x859911ad686a0859 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.705303:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000152eb6bb/0x859911ad686a0859 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.705321:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000152eb6bb/0x859911ad686a0859 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.705334:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.705335:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.705337:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787076070.705399:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.705404:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fc28bb3/0x859911ad686a0860 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.705413:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.705416:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.705420:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fc28bb3/0x859911ad686a0860 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.705429:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fc28bb3/0x859911ad686a0860 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.705436:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fc28bb3/0x859911ad686a0860 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.705443:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fc28bb3/0x859911ad686a0860 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.705474:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787076070.705739:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787076070.705745:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fc28bb3/0x859911ad686a0860 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.705753:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125dc00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787076070.705757:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fc28bb3/0x859911ad686a0860 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.705764:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fc28bb3/0x859911ad686a0860 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.705775:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fc28bb3/0x859911ad686a0860 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.705783:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fc28bb3/0x859911ad686a0860 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.705796:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.705798:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.705799:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787076070.705887:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787076070.705892:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fff3be17/0x859911ad686a0867 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.705901:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1787076070.705904:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076070.705908:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fff3be17/0x859911ad686a0867 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.705917:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fff3be17/0x859911ad686a0867 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.705924:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fff3be17/0x859911ad686a0867 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.705931:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fff3be17/0x859911ad686a0867 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.705950:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787076070.705982:0:16041:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787076070.705987:0:16041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fff3be17/0x859911ad686a0867 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.705994:0:16041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125d600 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787076070.705998:0:16041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fff3be17/0x859911ad686a0867 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.706005:0:16041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fff3be17/0x859911ad686a0867 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.706015:0:16041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fff3be17/0x859911ad686a0867 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.706022:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fff3be17/0x859911ad686a0867 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.706035:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.706036:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.706038:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787076070.708597:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787076070.708609:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a086e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.708626:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787076070.708630:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787076070.708635:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a086e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.708973:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a086e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.708987:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a086e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.708995:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a086e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.709063:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787076070.709526:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787076070.709533:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad686a0875 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.709542:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787076070.709546:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787076070.709550:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad686a0875 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.709560:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad686a0875 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.709568:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad686a0875 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.709586:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad686a0875 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.709793:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787076070.709802:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a086e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.709811:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523800 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787076070.709823:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a086e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.709834:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a086e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.709851:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a086e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.709859:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a086e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.709876:0:14313:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787076070.709880:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad686a0875 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.709886:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522a00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787076070.709888:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad686a0875 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.709908:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad686a0875 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.709918:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad686a0875 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.709926:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076070.709932:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076070.709935:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.710114:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787076070.710119:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030d06a55/0x859911ad686a0875 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.710591:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787076070.711179:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787076070.711186:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc45c4b9/0x859911ad686a087c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.711198:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787076070.711202:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787076070.711206:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc45c4b9/0x859911ad686a087c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.711217:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc45c4b9/0x859911ad686a087c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.711224:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc45c4b9/0x859911ad686a087c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.711232:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc45c4b9/0x859911ad686a087c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.711305:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787076070.711795:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787076070.711800:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c831fba/0x859911ad686a0883 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.711810:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=452s v=(0 0) 00010000:00010000:3.0:1787076070.711813:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787076070.711816:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c831fba/0x859911ad686a0883 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.711825:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c831fba/0x859911ad686a0883 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.711833:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c831fba/0x859911ad686a0883 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076070.711840:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c831fba/0x859911ad686a0883 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.712191:0:16041:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787076070.712199:0:16041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc45c4b9/0x859911ad686a087c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.712207:0:16041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523200 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787076070.712211:0:16041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc45c4b9/0x859911ad686a087c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.712220:0:16041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc45c4b9/0x859911ad686a087c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.712235:0:16041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc45c4b9/0x859911ad686a087c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076070.712242:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc45c4b9/0x859911ad686a087c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076070.712310:0:16041:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787076070.712316:0:16041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c831fba/0x859911ad686a0883 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076070.712323:0:16041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522e00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787076070.712327:0:16041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c831fba/0x859911ad686a0883 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076070.712335:0:16041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c831fba/0x859911ad686a0883 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076070.712360:0:16041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c831fba/0x859911ad686a0883 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076070.712368:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076070.712370:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076070.712371:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787076070.712432:0:15009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787076070.712437:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c831fba/0x859911ad686a0883 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787076070.712827:0:15009:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1787076070.712973:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14348:x1873884700836480:12345-0@lo:5:osp-pre-1-0.0 Request processed in 106057us (106265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076070.712990:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787076070.713117:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787076070.713171:0:14348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14348:1873884700836480:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787076070.713188:0:14348:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1787076070.713235:0:14348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14348:1873884700836608:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787076070.713272:0:14348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076070.713348:0:14348:0:(client.c:2702:ptlrpc_set_wait()) set ffff99618954d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787076070.713384:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700836608 00000100:00100000:0.0:1787076070.713391:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700836608 00000100:00100000:0.0:1787076070.713464:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787076070.713590:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14348:x1873884700836608:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787076070.713629:0:15008:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1787076070.722741:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14348:x1873884700836608:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9145us (9458us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787076070.722757:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787076070.722890:0:14348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14348:1873884700836608:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787076070.723004:0:14348:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1787076070.856946:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787076071.553907:0:16099:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787076071.885010:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076072.903973:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076073.930991:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787076074.016921:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076074.017250:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678823808 00000100:00100000:0.0:1787076074.017261:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678823808 00000100:00100000:0.0:1787076074.017310:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:0.0:1787076074.017318:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2358:x1873884678823808:12345-192.168.204.50@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787076074.017349:0:14316:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 2b749548-aa04-4561-b46c-adb589deaa28@192.168.204.50@tcp t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:0.0:1787076074.017377:0:14316:0:(genops.c:1406:class_connect()) connect: client 2b749548-aa04-4561-b46c-adb589deaa28, cookie 0x859911ad686a088a 00000100:00080000:0.0:1787076074.017513:0:14316:0:(import.c:65:import_set_state_nolock()) ffff9961c14df000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787076074.017591:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+5:2358:x1873884678823808:12345-192.168.204.50@tcp:250:mount.lustre.0 Request processed in 271us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076074.017600:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:3.0:1787076074.020822:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076074.020960:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678823936 00000100:00100000:1.0:1787076074.020975:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678823936 00000100:00100000:1.0:1787076074.021056:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 76 00000100:00100000:1.0:1787076074.021069:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baeddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+5:13739:x1873884678823936:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787076074.021095:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787076074.021120:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996190038e00/0x859911ad686a0891 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76237ba expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076074.021163:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996190038e00/0x859911ad686a0891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76237ba expref: 6 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076074.021177:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996190038e00/0x859911ad686a0891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76237ba expref: 6 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076074.021210:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190038e00, rc 0) 00000100:00100000:1.0:1787076074.021291:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baeddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+6:13739:x1873884678823936:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 224us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076074.021299:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 76 00000100:00100000:2.0:1787076074.033419:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076074.033545:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678824064 00000100:00100000:1.0:1787076074.033567:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678824064 00000100:00100000:0.0:1787076074.033838:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:0.0:1787076074.033860:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+6:13739:x1873884678824064:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787076074.034256:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+6:13739:x1873884678824064:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 404us (848us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787076074.034265:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:3.0:1787076074.039974:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076074.040312:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678824192 00000100:00100000:1.0:1787076074.040326:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678824192 00000100:00100000:1.0:1787076074.040408:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:1.0:1787076074.040422:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+6:13739:x1873884678824192:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787076074.040453:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787076074.040477:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996190039600/0x859911ad686a0898 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76237c1 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076074.040525:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996190039600/0x859911ad686a0898 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76237c1 expref: 7 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076074.040539:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996190039600/0x859911ad686a0898 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76237c1 expref: 7 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076074.040551:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190039600, rc 0) 00000100:00100000:1.0:1787076074.040634:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+7:13739:x1873884678824192:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 215us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076074.040689:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:3.0:1787076074.045192:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076074.045515:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678824320 00000100:00100000:0.0:1787076074.045528:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678824320 00000100:00100000:0.0:1787076074.045614:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:0.0:1787076074.045627:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+7:13739:x1873884678824320:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787076074.048168:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+8:13739:x1873884678824320:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 2523us (2972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076074.048202:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:2.0:1787076074.065535:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076074.066056:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678824448 00000100:00100000:0.0:1787076074.066071:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678824448 00000100:00100000:0.0:1787076074.066149:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 80 00000100:00100000:0.0:1787076074.066162:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b749548-aa04-4561-b46c-adb589deaa28+8:13739:x1873884678824448:12345-192.168.204.50@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787076074.066507:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b749548-aa04-4561-b46c-adb589deaa28+8:13739:x1873884678824448:12345-192.168.204.50@tcp:503:mount.lustre.0 Request processed in 347us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076074.066516:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 80 00000100:00100000:2.0:1787076074.077815:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076074.082494:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678824576 00000100:00100000:0.0:1787076074.082518:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678824576 00000100:00100000:0.0:1787076074.082611:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00100000:0.0:1787076074.082623:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+8:13758:x1873884678824576:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787076074.083539:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+8:13758:x1873884678824576:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 911us (5735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076074.083551:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00100000:3.0:1787076074.106216:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076074.106615:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678824704 00000100:00100000:1.0:1787076074.106631:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678824704 00000100:00100000:1.0:1787076074.107314:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:1.0:1787076074.107326:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+8:13758:x1873884678824704:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787076074.109012:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+8:13758:x1873884678824704:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 1678us (2803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076074.109031:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:2.0:1787076074.114796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076074.115305:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678824832 00000100:00100000:0.0:1787076074.115321:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678824832 00000100:00100000:0.0:1787076074.115406:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 83 00000100:00100000:0.0:1787076074.115419:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+8:13739:x1873884678824832:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787076074.115443:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787076074.115468:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99608125c400/0x859911ad686a089f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76237eb expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076074.115517:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99608125c400/0x859911ad686a089f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76237eb expref: 9 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076074.115556:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99608125c400/0x859911ad686a089f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76237eb expref: 9 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076074.115569:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99608125c400, rc 0) 00000100:00100000:0.0:1787076074.115702:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+9:13739:x1873884678824832:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 286us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076074.115711:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 83 00000100:00100000:3.0:1787076074.127401:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076074.127804:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678824960 00000100:00100000:1.0:1787076074.127821:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678824960 00000100:00100000:1.0:1787076074.127917:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:1.0:1787076074.127929:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+9:13739:x1873884678824960:12345-192.168.204.50@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787076074.127969:0:14317:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787076074.128004:0:14317:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787076074.128008:0:14317:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787076074.128011:0:14317:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787076074.128013:0:14317:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787076074.133374:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+9:13739:x1873884678824960:12345-192.168.204.50@tcp:256:mount.lustre.0 Request processed in 5429us (5970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076074.133396:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:0.0:1787076074.138942:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076074.139062:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678825088 00000100:00100000:3.0:1787076074.139076:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678825088 00000100:00100000:3.0:1787076074.139152:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:3.0:1787076074.139163:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+9:13739:x1873884678825088:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787076074.139187:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787076074.139212:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181522e00/0x859911ad686a08a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76237f2 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076074.139253:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181522e00/0x859911ad686a08a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76237f2 expref: 10 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076074.139267:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181522e00/0x859911ad686a08a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76237f2 expref: 10 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076074.139278:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522e00, rc 0) 00000100:00100000:3.0:1787076074.139363:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+10:13739:x1873884678825088:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 201us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076074.139392:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:3.0:1787076074.142221:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076074.143347:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678825216 00000100:00100000:1.0:1787076074.143367:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678825216 00000100:00100000:1.0:1787076074.143522:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 86 00000100:00100000:1.0:1787076074.143536:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961baedd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+10:13739:x1873884678825216:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787076074.145106:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961baedd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+10:13739:x1873884678825216:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 1563us (2888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076074.145121:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 86 00000100:00100000:1.0:1787076074.154770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076074.155009:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678825344 00000100:00100000:2.0:1787076074.155024:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678825344 00000100:00100000:2.0:1787076074.155105:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 87 00000100:00100000:2.0:1787076074.155119:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfd7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b749548-aa04-4561-b46c-adb589deaa28+10:13739:x1873884678825344:12345-192.168.204.50@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787076074.155444:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfd7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b749548-aa04-4561-b46c-adb589deaa28+10:13739:x1873884678825344:12345-192.168.204.50@tcp:503:mount.lustre.0 Request processed in 327us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076074.155454:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 87 00000100:00100000:0.0:1787076074.159847:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076074.160100:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678825472 00000100:00100000:1.0:1787076074.160132:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678825472 00000100:00100000:1.0:1787076074.160212:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 88 00000100:00100000:1.0:1787076074.160225:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfd7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+10:13764:x1873884678825472:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787076074.160574:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfd7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+10:13764:x1873884678825472:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 351us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076074.160584:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 88 00000100:00100000:2.0:1787076074.167911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076074.168008:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678825600 00000100:00100000:3.0:1787076074.168024:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678825600 00000100:00100000:3.0:1787076074.168100:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:3.0:1787076074.168111:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfd7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+10:13764:x1873884678825600:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787076074.168943:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfd7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+10:13764:x1873884678825600:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 828us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076074.168955:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:1.0:1787076074.184938:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700836736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787076074.185045:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076074.185164:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700836736 00000100:00100000:2.0:1787076074.185176:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700836736 00000100:00100000:2.0:1787076074.185268:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787076074.185280:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700836736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787076074.185330:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787076074.185482:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787076074.198768:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700836736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13476us (13708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076074.198791:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787076074.200376:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700836736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787076074.201116:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076074.201519:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678825728 00000100:00100000:1.0:1787076074.201531:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678825728 00000100:00100000:1.0:1787076074.201597:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:1.0:1787076074.201606:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1873884678825728:12345-192.168.204.50@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787076074.201678:0:14325:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 68657535-b9e1-4ead-a295-31f2243e0fc4@192.168.204.50@tcp t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:1.0:1787076074.201740:0:14325:0:(genops.c:1406:class_connect()) connect: client 68657535-b9e1-4ead-a295-31f2243e0fc4, cookie 0x859911ad686a08ad 00000004:00100000:1.0:1787076074.201781:0:14325:0:(mdt_handler.c:7347:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1787076074.201788:0:14325:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787076074.258626:0:14325:0:(import.c:65:import_set_state_nolock()) ffff9961c14db000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787076074.258776:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+6:2358:x1873884678825728:12345-192.168.204.50@tcp:38:mount.lustre.0 Request processed in 57167us (57662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076074.258791:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:2.0:1787076074.263704:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076074.264015:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076074.264187:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678825984 00000100:00100000:1.0:1787076074.264201:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678825984 00000100:00100000:1.0:1787076074.264285:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678825856 00000100:00100000:1.0:1787076074.264289:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678825856 00000100:00100000:1.0:1787076074.264328:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:1.0:1787076074.264340:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+7:13739:x1873884678825984:12345-192.168.204.50@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787076074.264398:0:14323:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787076074.264501:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+7:13739:x1873884678825984:12345-192.168.204.50@tcp:41:mount.lustre.0 Request processed in 162us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076074.264527:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:1.0:1787076074.264547:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:1.0:1787076074.264554:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+6:0:x1873884678825856:12345-192.168.204.50@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787076074.264565:0:14323:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787076074.264590:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+6:0:x1873884678825856:12345-192.168.204.50@tcp:41:mount.lustre.0 Request processed in 37us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076074.264596:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00080000:0.0:1787076074.264729:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787076074.269495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076074.269773:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678826112 00000100:00100000:1.0:1787076074.269787:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678826112 00000100:00100000:1.0:1787076074.269917:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:1.0:1787076074.269930:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+6:13739:x1873884678826112:12345-192.168.204.50@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787076074.270053:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+6:13739:x1873884678826112:12345-192.168.204.50@tcp:40:mount.lustre.0 Request processed in 125us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076074.270060:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:3.0:1787076074.274379:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076074.274424:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076074.274475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076074.274769:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678826496 00000100:00100000:2.0:1787076074.274783:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678826496 00000100:00100000:2.0:1787076074.274834:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:2.0:1787076074.274844:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+6:13739:x1873884678826496:12345-192.168.204.50@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787076074.275808:0:14326:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 865us 00000100:00100000:0.0:1787076074.276386:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678826240 00000100:00100000:0.0:1787076074.276397:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678826240 00000100:00100000:0.0:1787076074.276433:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678826368 00000100:00100000:0.0:1787076074.276437:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678826368 00000100:00100000:0.0:1787076074.276454:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:0.0:1787076074.276463:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1873884678826240:12345-192.168.204.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787076074.276498:0:15006:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 68657535-b9e1-4ead-a295-31f2243e0fc4@192.168.204.50@tcp t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:0.0:1787076074.276540:0:15006:0:(genops.c:1406:class_connect()) connect: client 68657535-b9e1-4ead-a295-31f2243e0fc4, cookie 0x859911ad686a08b4 00002000:00100000:0.0:1787076074.276554:0:15006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 68657535-b9e1-4ead-a295-31f2243e0fc4/ffff9961c14d8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787076074.276569:0:15006:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787076074.277010:0:15006:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787076074.277456:0:15006:0:(import.c:65:import_set_state_nolock()) ffff9961c14db800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787076074.277559:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+6:2358:x1873884678826240:12345-192.168.204.50@tcp:8:mount.lustre.0 Request processed in 1095us (3191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076074.277569:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:0.0:1787076074.277605:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:0.0:1787076074.277611:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1873884678826368:12345-192.168.204.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787076074.277635:0:15006:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 68657535-b9e1-4ead-a295-31f2243e0fc4@192.168.204.50@tcp t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:0.0:1787076074.277690:0:15006:0:(genops.c:1406:class_connect()) connect: client 68657535-b9e1-4ead-a295-31f2243e0fc4, cookie 0x859911ad686a08bb 00002000:00100000:0.0:1787076074.277700:0:15006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 68657535-b9e1-4ead-a295-31f2243e0fc4/ffff9961c14dc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787076074.277723:0:15006:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787076074.277881:0:15006:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787076074.277927:0:15006:0:(import.c:65:import_set_state_nolock()) ffff9961c14dd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787076074.277953:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+6:2358:x1873884678826368:12345-192.168.204.50@tcp:8:mount.lustre.0 Request processed in 341us (3528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076074.277960:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000004:00200000:3.0:1787076074.299202:0:14326:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787076074.303713:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+6:13739:x1873884678826496:12345-192.168.204.50@tcp:33:mount.lustre.0 Request processed in 28849us (29217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076074.303743:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:3.0:1787076074.458905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076074.459433:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678826624 00000100:00100000:2.0:1787076074.459449:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678826624 00000100:00100000:2.0:1787076074.459542:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:2.0:1787076074.459556:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+6:13785:x1873884678826624:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:2.0:1787076074.459585:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787076074.459622:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a08c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762381c expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076074.459765:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a08c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076074.459781:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a08c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076074.459817:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a08c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787076074.460328:0:14324:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787076074.460334:0:14324:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787076074.460445:0:14324:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a08c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076074.460482:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a08c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762381c expref: 8 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076074.460731:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a08c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762381c expref: 7 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076074.460743:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b79300) 00010000:00010000:2.0:1787076074.460747:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787076074.460751:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1841400, rc 0) 00000100:00100000:2.0:1787076074.460844:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+7:13785:x1873884678826624:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 1290us (1970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076074.460853:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00010000:00010000:1.0:1787076074.954272:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787076075.720057:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700836864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787076075.720167:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076075.720775:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700836864 00000100:00100000:1.0:1787076075.720788:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700836864 00000100:00100000:1.0:1787076075.720890:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787076075.720902:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1873884700836864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787076075.720938:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787076075.721003:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1873884700836864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076075.721011:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787076075.721096:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787076075.721147:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700836864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787076075.731298:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700837120:0@lo:400:kworker.0 00000100:00100000:1.0:1787076075.731450:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076075.731550:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787076075.731558:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700837248:0@lo:400:kworker.0 00000100:00100000:1.0:1787076075.732380:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076075.732456:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700837120 00000100:00100000:1.0:1787076075.732485:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700837120 00000100:00100000:1.0:1787076075.732563:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787076075.732575:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700837120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787076075.735335:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700837248 00000100:00100000:3.0:1787076075.735358:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700837248 00000100:00100000:3.0:1787076075.735432:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787076075.735445:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700837248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787076075.735587:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700837248:12345-0@lo:400:kworker.0 Request processed in 145us (3211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076075.735609:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787076075.735671:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700837376:0@lo:400:kworker.0 00000100:00100000:3.0:1787076075.735719:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076075.735759:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787076075.735766:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51646941-6761-4bd4-bf4b-97125ced6c1b:3313:1873884700836992:0@lo:400:kworker.0 00000100:00100000:3.0:1787076075.735797:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076075.735826:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700837504:0@lo:400:kworker.0 00000100:00100000:3.0:1787076075.735876:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076075.735904:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700837376 00000100:00100000:3.0:1787076075.735908:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700837376 00000100:00100000:3.0:1787076075.735941:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700837504 00000100:00100000:3.0:1787076075.735944:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700837504 00000100:00100000:3.0:1787076075.735960:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787076075.735967:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700837376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787076075.736007:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700837376:12345-0@lo:400:kworker.0 Request processed in 39us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076075.736014:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787076075.736027:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787076075.736033:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700837504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787076075.736059:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700837504:12345-0@lo:400:kworker.0 Request processed in 27us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076075.736065:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787076075.736108:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700837504:0@lo:400:kworker.0 00000100:00100000:3.0:1787076075.736121:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700837376:0@lo:400:kworker.0 00000100:00100000:3.0:1787076075.736182:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700837248:0@lo:400:kworker.0 00000100:00100000:1.0:1787076075.737018:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700837120:12345-0@lo:400:kworker.0 Request processed in 4444us (5566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076075.737029:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787076075.737073:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700837120:0@lo:400:kworker.0 00000100:00100000:2.0:1787076075.738613:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700836992 00000100:00100000:2.0:1787076075.738634:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700836992 00000100:00100000:2.0:1787076075.738741:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787076075.738772:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfd7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+19:3313:x1873884700836992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787076075.738905:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfd7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+19:3313:x1873884700836992:12345-0@lo:400:kworker.0 Request processed in 135us (3106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076075.738915:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1787076075.739727:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787076075.739781:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51646941-6761-4bd4-bf4b-97125ced6c1b:3313:1873884700836992:0@lo:400:kworker.0 00000001:00100000:3.0:1787076075.915236:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 68657535-b9e1-4ead-a295-31f2243e0fc4 00000001:00080000:3.0:1787076075.915289:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1787076075.975982:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787076076.333190:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68657535-b9e1-4ead-a295-31f2243e0fc4 00000100:00100000:2.0:1787076076.637879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076076.642153:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678826752 00000100:00100000:3.0:1787076076.642175:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678826752 00000100:00100000:3.0:1787076076.642389:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:3.0:1787076076.642403:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+7:13838:x1873884678826752:12345-192.168.204.50@tcp:41:lfs.0 00000004:00000024:3.0:1787076076.642479:0:15531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787076076.642666:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+7:13838:x1873884678826752:12345-192.168.204.50@tcp:41:lfs.0 Request processed in 267us (4876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076076.642674:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00080000:2.0:1787076076.647363:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787076076.649441:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076076.649901:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678826880 00000100:00100000:1.0:1787076076.649917:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678826880 00000100:00100000:1.0:1787076076.650025:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:1.0:1787076076.650039:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68657535-b9e1-4ead-a295-31f2243e0fc4+5:13838:x1873884678826880:12345-192.168.204.50@tcp:13:lfs.0 00002000:00000024:1.0:1787076076.650090:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787076076.650215:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68657535-b9e1-4ead-a295-31f2243e0fc4+5:13838:x1873884678826880:12345-192.168.204.50@tcp:13:lfs.0 Request processed in 179us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076076.650223:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00080000:2.0:1787076076.651205:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787076076.653316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076076.660349:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678827008 00000100:00100000:0.0:1787076076.660373:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678827008 00000100:00080000:2.0:1787076076.661139:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787076076.661340:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:0.0:1787076076.661359:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68657535-b9e1-4ead-a295-31f2243e0fc4+5:13838:x1873884678827008:12345-192.168.204.50@tcp:13:lfs.0 00002000:00000024:0.0:1787076076.661412:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787076076.661788:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68657535-b9e1-4ead-a295-31f2243e0fc4+5:13838:x1873884678827008:12345-192.168.204.50@tcp:13:lfs.0 Request processed in 435us (8483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076076.661803:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:0.0:1787076076.869603:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076076.869785:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678827136 00000100:00100000:3.0:1787076076.869800:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678827136 00000100:00100000:3.0:1787076076.869886:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 91 00000100:00100000:3.0:1787076076.869897:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bfd7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+10:13869:x1873884678827136:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787076076.869921:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787076076.869945:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181522a00/0x859911ad686a08d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623823 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076076.869985:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181522a00/0x859911ad686a08d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623823 expref: 11 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076076.869999:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181522a00/0x859911ad686a08d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623823 expref: 11 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076076.870011:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522a00, rc 0) 00000100:00100000:3.0:1787076076.870088:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bfd7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+11:13869:x1873884678827136:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 192us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076076.870112:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 91 00000100:00100000:1.0:1787076076.885100:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076076.885358:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678827264 00000100:00100000:2.0:1787076076.885372:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678827264 00000100:00100000:2.0:1787076076.885442:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 92 00000100:00100000:2.0:1787076076.885455:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996198719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+11:13869:x1873884678827264:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787076076.886402:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996198719850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+11:13869:x1873884678827264:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 944us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076076.886416:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 92 00000100:00100000:1.0:1787076076.905824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076076.905966:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678827392 00000100:00100000:2.0:1787076076.906126:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678827392 00000100:00100000:2.0:1787076076.906198:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 93 00000100:00100000:2.0:1787076076.906210:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99619871b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b749548-aa04-4561-b46c-adb589deaa28+11:13869:x1873884678827392:12345-192.168.204.50@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787076076.908336:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99619871b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b749548-aa04-4561-b46c-adb589deaa28+11:13869:x1873884678827392:12345-192.168.204.50@tcp:503:mount.lustre.0 Request processed in 2111us (2511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076076.908353:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 93 00000100:00100000:0.0:1787076076.922078:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076076.926613:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678827520 00000100:00100000:2.0:1787076076.926636:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678827520 00000100:00100000:2.0:1787076076.926769:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 94 00000100:00100000:2.0:1787076076.926781:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996198718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+11:13876:x1873884678827520:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787076076.927254:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996198718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+11:13876:x1873884678827520:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 473us (5187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076076.927264:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 94 00000100:00100000:1.0:1787076076.951084:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076076.951897:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678827648 00000100:00100000:2.0:1787076076.951913:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678827648 00000100:00100000:2.0:1787076076.951995:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 95 00000100:00100000:2.0:1787076076.952008:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996198718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b749548-aa04-4561-b46c-adb589deaa28+11:13876:x1873884678827648:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787076076.952383:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996198718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b749548-aa04-4561-b46c-adb589deaa28+11:13876:x1873884678827648:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 376us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076076.952393:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 95 00000100:00100000:1.0:1787076076.967194:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076076.967500:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678827776 00000100:00100000:3.0:1787076076.967514:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678827776 00000100:00100000:3.0:1787076076.967589:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 96 00000100:00100000:3.0:1787076076.967603:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996198719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+11:13869:x1873884678827776:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787076076.967626:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787076076.967693:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996181523c00/0x859911ad686a08d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762384d expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076076.967729:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996181523c00/0x859911ad686a08d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762384d expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076076.967742:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996181523c00/0x859911ad686a08d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762384d expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076076.967753:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523c00, rc 0) 00000100:00100000:3.0:1787076076.967853:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996198719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+12:13869:x1873884678827776:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 253us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076076.967861:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 96 00000100:00100000:0.0:1787076076.972986:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076076.973157:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678827904 00000100:00100000:1.0:1787076076.973172:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678827904 00000100:00100000:1.0:1787076076.973247:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 97 00000100:00100000:1.0:1787076076.973260:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a17a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+12:13869:x1873884678827904:12345-192.168.204.50@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787076076.973297:0:14317:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787076076.973325:0:14317:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787076076.973330:0:14317:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787076076.973334:0:14317:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787076076.973336:0:14317:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787076076.985002:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a17a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+12:13869:x1873884678827904:12345-192.168.204.50@tcp:256:mount.lustre.0 Request processed in 11719us (12008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076076.985023:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 97 00000100:00100000:3.0:1787076076.996763:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076076.997210:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678828032 00000100:00100000:2.0:1787076076.997224:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678828032 00000100:00100000:2.0:1787076076.997296:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 98 00000100:00100000:2.0:1787076076.997306:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b749548-aa04-4561-b46c-adb589deaa28+12:13869:x1873884678828032:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787076076.997327:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787076076.997350:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961c1841c00/0x859911ad686a08de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623854 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076076.997386:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961c1841c00/0x859911ad686a08de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623854 expref: 13 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076076.997420:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961c1841c00/0x859911ad686a08de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623854 expref: 13 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076076.997431:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1841c00, rc 0) 00000100:00100000:2.0:1787076076.997733:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b749548-aa04-4561-b46c-adb589deaa28+13:13869:x1873884678828032:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 426us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076076.997741:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 98 00010000:00010000:1.0:1787076077.001316:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787076077.001910:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076077.002097:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678828160 00000100:00100000:2.0:1787076077.002111:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678828160 00000100:00100000:2.0:1787076077.002214:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 99 00000100:00100000:2.0:1787076077.002227:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+13:13869:x1873884678828160:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787076077.002666:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+13:13869:x1873884678828160:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 412us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076077.002676:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 99 00000100:00100000:1.0:1787076077.007630:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076077.008864:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678828288 00000100:00100000:3.0:1787076077.008886:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678828288 00000100:00100000:3.0:1787076077.009146:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 100 00000100:00100000:3.0:1787076077.009161:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+13:13869:x1873884678828288:12345-192.168.204.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787076077.009698:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+13:13869:x1873884678828288:12345-192.168.204.50@tcp:503:mount.lustre.0 Request processed in 538us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076077.009718:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 100 00000100:00100000:3.0:1787076077.016536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076077.016985:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678828416 00000100:00100000:2.0:1787076077.017000:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678828416 00000100:00100000:2.0:1787076077.017085:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 101 00000100:00100000:2.0:1787076077.017098:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+13:13880:x1873884678828416:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787076077.017877:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+13:13880:x1873884678828416:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 776us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076077.017890:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 101 00000100:00100000:1.0:1787076077.023616:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076077.023767:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678828544 00000100:00100000:3.0:1787076077.023781:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678828544 00000100:00100000:3.0:1787076077.023863:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 102 00000100:00100000:3.0:1787076077.023877:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+13:13880:x1873884678828544:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787076077.024257:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+13:13880:x1873884678828544:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 382us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076077.024267:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 102 00000100:00100000:1.0:1787076077.033416:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076077.033592:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678828672 00000100:00100000:3.0:1787076077.033606:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678828672 00000100:00100000:3.0:1787076077.033815:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:3.0:1787076077.033825:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2358:x1873884678828672:12345-192.168.204.50@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787076077.033876:0:14323:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 703f1470-5b22-4bd9-b310-b8043c4ba269@192.168.204.50@tcp t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:3.0:1787076077.034223:0:14323:0:(genops.c:1406:class_connect()) connect: client 703f1470-5b22-4bd9-b310-b8043c4ba269, cookie 0x859911ad686a08e5 00000004:00100000:3.0:1787076077.034275:0:14323:0:(mdt_handler.c:7347:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787076077.034440:0:14323:0:(import.c:65:import_set_state_nolock()) ffff996081286800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787076077.034595:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:703f1470-5b22-4bd9-b310-b8043c4ba269+6:2358:x1873884678828672:12345-192.168.204.50@tcp:38:mount.lustre.0 Request processed in 769us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076077.034606:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:1.0:1787076077.048880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076077.048951:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076077.049149:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678828928 00000100:00100000:3.0:1787076077.049164:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678828928 00000100:00100000:3.0:1787076077.049260:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678828800 00000100:00100000:3.0:1787076077.049263:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678828800 00000100:00100000:3.0:1787076077.049293:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:3.0:1787076077.049305:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:703f1470-5b22-4bd9-b310-b8043c4ba269+7:13869:x1873884678828928:12345-192.168.204.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787076077.049389:0:15531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787076077.049492:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:703f1470-5b22-4bd9-b310-b8043c4ba269+7:13869:x1873884678828928:12345-192.168.204.50@tcp:41:mount.lustre.0 Request processed in 189us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076077.049500:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:3.0:1787076077.049520:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:3.0:1787076077.049527:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:703f1470-5b22-4bd9-b310-b8043c4ba269+6:0:x1873884678828800:12345-192.168.204.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787076077.049538:0:15531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787076077.049564:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:703f1470-5b22-4bd9-b310-b8043c4ba269+6:0:x1873884678828800:12345-192.168.204.50@tcp:41:mount.lustre.0 Request processed in 38us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076077.049570:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00080000:2.0:1787076077.049770:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787076077.055313:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076077.056227:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678829056 00000100:00100000:3.0:1787076077.056243:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678829056 00000100:00100000:3.0:1787076077.056332:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:3.0:1787076077.056345:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:703f1470-5b22-4bd9-b310-b8043c4ba269+6:13869:x1873884678829056:12345-192.168.204.50@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787076077.056616:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:703f1470-5b22-4bd9-b310-b8043c4ba269+6:13869:x1873884678829056:12345-192.168.204.50@tcp:40:mount.lustre.0 Request processed in 273us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076077.056625:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:1.0:1787076077.065495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076077.065557:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076077.065591:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076077.065635:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076077.065693:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076077.065717:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076077.065739:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076077.065775:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678829824 00000100:00100000:1.0:1787076077.065788:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678829824 00000100:00100000:1.0:1787076077.065853:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678829952 00000100:00100000:1.0:1787076077.065857:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678829952 00000100:00100000:1.0:1787076077.065869:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678829184 00000100:00100000:1.0:1787076077.065871:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678829184 00000100:00100000:1.0:1787076077.065911:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:1.0:1787076077.065922:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+5:2360:x1873884678829824:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787076077.066023:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+5:2360:x1873884678829824:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 103us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076077.066032:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:1.0:1787076077.066052:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:1.0:1787076077.066059:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+5:2360:x1873884678829952:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787076077.066085:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+5:2360:x1873884678829952:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076077.066091:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:1.0:1787076077.066103:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:1.0:1787076077.066107:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1873884678829184:12345-192.168.204.50@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787076077.066138:0:15006:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 703f1470-5b22-4bd9-b310-b8043c4ba269@192.168.204.50@tcp t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:1.0:1787076077.066176:0:15006:0:(genops.c:1406:class_connect()) connect: client 703f1470-5b22-4bd9-b310-b8043c4ba269, cookie 0x859911ad686a08ec 00002000:00100000:1.0:1787076077.066190:0:15006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 703f1470-5b22-4bd9-b310-b8043c4ba269/ffff99608269c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787076077.066202:0:15006:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787076077.066524:0:15006:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787076077.066561:0:15006:0:(import.c:65:import_set_state_nolock()) ffff996082699000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787076077.066594:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:703f1470-5b22-4bd9-b310-b8043c4ba269+6:2358:x1873884678829184:12345-192.168.204.50@tcp:8:mount.lustre.0 Request processed in 485us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076077.066602:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:1.0:1787076077.066633:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678830080 00000100:00100000:1.0:1787076077.066669:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678830080 00000100:00100000:1.0:1787076077.066699:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678829696 00000100:00100000:1.0:1787076077.066713:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678829696 00000100:00100000:1.0:1787076077.066736:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:1.0:1787076077.066742:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:703f1470-5b22-4bd9-b310-b8043c4ba269+6:2360:x1873884678830080:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787076077.066777:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:703f1470-5b22-4bd9-b310-b8043c4ba269+6:2360:x1873884678830080:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 35us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076077.066783:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:1.0:1787076077.066795:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:1.0:1787076077.066802:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+7:2360:x1873884678829696:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787076077.066826:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+7:2360:x1873884678829696:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 24us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076077.066832:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:3.0:1787076077.067115:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678829440 00000100:00100000:3.0:1787076077.067121:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678829440 00000100:00100000:3.0:1787076077.067165:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:3.0:1787076077.067173:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:703f1470-5b22-4bd9-b310-b8043c4ba269+6:13869:x1873884678829440:12345-192.168.204.50@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787076077.067491:0:14327:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787076077.067634:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:703f1470-5b22-4bd9-b310-b8043c4ba269+6:13869:x1873884678829440:12345-192.168.204.50@tcp:33:mount.lustre.0 Request processed in 461us (2157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076077.067689:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:2.0:1787076077.067932:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678829568 00000100:00100000:2.0:1787076077.067940:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678829568 00000100:00100000:2.0:1787076077.067988:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 103 00000100:00100000:2.0:1787076077.068006:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+13:2360:x1873884678829568:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787076077.068057:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+13:2360:x1873884678829568:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 53us (2499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076077.068065:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 103 00000100:00100000:1.0:1787076077.094196:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076077.097123:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678829312 00000100:00100000:2.0:1787076077.097146:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678829312 00000100:00100000:2.0:1787076077.097226:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:2.0:1787076077.097239:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1873884678829312:12345-192.168.204.50@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787076077.097287:0:15006:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 703f1470-5b22-4bd9-b310-b8043c4ba269@192.168.204.50@tcp t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:2.0:1787076077.097333:0:15006:0:(genops.c:1406:class_connect()) connect: client 703f1470-5b22-4bd9-b310-b8043c4ba269, cookie 0x859911ad686a08f3 00002000:00100000:2.0:1787076077.097350:0:15006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 703f1470-5b22-4bd9-b310-b8043c4ba269/ffff996083416000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787076077.097367:0:15006:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787076077.097961:0:15006:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787076077.098378:0:15006:0:(import.c:65:import_set_state_nolock()) ffff996083412800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787076077.098543:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:703f1470-5b22-4bd9-b310-b8043c4ba269+6:2358:x1873884678829312:12345-192.168.204.50@tcp:8:mount.lustre.0 Request processed in 1302us (4360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076077.098554:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:0.0:1787076077.284319:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076077.284622:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678830208 00000100:00100000:1.0:1787076077.284637:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678830208 00000100:00100000:1.0:1787076077.284750:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:1.0:1787076077.284763:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:703f1470-5b22-4bd9-b310-b8043c4ba269+6:13901:x1873884678830208:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:1.0:1787076077.284791:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787076077.284822:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190039e00/0x859911ad686a08fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762387e expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076077.284923:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0901 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076077.284940:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076077.284958:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787076077.285681:0:14324:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787076077.285690:0:14324:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787076077.285790:0:14324:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076077.285842:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190039e00/0x859911ad686a08fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762387e expref: 8 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076077.285869:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0901 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762387e expref: 7 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076077.285880:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b79300) 00010000:00010000:1.0:1787076077.285884:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787076077.285888:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190039800, rc 0) 00000100:00100000:1.0:1787076077.286184:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:703f1470-5b22-4bd9-b310-b8043c4ba269+7:13901:x1873884678830208:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 1421us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076077.286195:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00010000:00010000:1.0:1787076078.025833:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787076079.048855:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787076079.305279:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787076079.305314:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700837632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787076079.305433:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076079.305627:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700837632 00000100:00100000:3.0:1787076079.305651:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700837632 00000100:00100000:3.0:1787076079.305722:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787076079.305734:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700837632:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787076079.305779:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787076079.305780:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787076079.305978:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700837632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 246us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076079.305987:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787076079.306350:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700837632:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787076079.366869:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 68657535-b9e1-4ead-a295-31f2243e0fc4 00000001:00100000:2.0:1787076079.366893:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 703f1470-5b22-4bd9-b310-b8043c4ba269 00010000:00010000:1.0:1787076080.072495:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787076080.457263:0:14356:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1787076080.743992:0:16304:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1787076080.840071:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700838144:0@lo:400:kworker.0 00000100:00100000:2.0:1787076080.840147:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076080.840208:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787076080.840214:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51646941-6761-4bd4-bf4b-97125ced6c1b:3311:1873884700837760:0@lo:400:kworker.0 00000100:00100000:2.0:1787076080.840242:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076080.840277:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700838272:0@lo:400:kworker.0 00000100:00100000:2.0:1787076080.840299:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076080.840326:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700837888:0@lo:400:kworker.0 00000100:00100000:2.0:1787076080.840349:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076080.840384:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700838400:0@lo:400:kworker.0 00000100:00100000:2.0:1787076080.840411:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076080.840430:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787076080.840436:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700838016:0@lo:400:kworker.0 00000100:00100000:2.0:1787076080.840457:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076080.840496:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700838144 00000100:00100000:2.0:1787076080.840504:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700838144 00000100:00100000:2.0:1787076080.840550:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700838272 00000100:00100000:2.0:1787076080.840554:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700838272 00000100:00100000:2.0:1787076080.840576:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700838400 00000100:00100000:2.0:1787076080.840579:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700838400 00000100:00100000:2.0:1787076080.840595:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787076080.840602:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700838144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787076080.840709:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873884700838144:12345-0@lo:400:kworker.0 Request processed in 106us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076080.840717:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787076080.840736:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787076080.840743:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700838272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787076080.840784:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873884700838272:12345-0@lo:400:kworker.0 Request processed in 42us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076080.840790:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787076080.840802:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787076080.840809:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700838400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787076080.840848:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1873884700838400:12345-0@lo:400:kworker.0 Request processed in 40us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076080.840854:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787076080.840875:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700837760 00000100:00100000:2.0:1787076080.840879:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700837760 00000100:00100000:2.0:1787076080.840902:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787076080.840908:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+19:3311:x1873884700837760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787076080.840936:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+19:3311:x1873884700837760:12345-0@lo:400:kworker.0 Request processed in 29us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076080.840943:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787076080.840970:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700837888 00000100:00100000:2.0:1787076080.840974:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700837888 00000100:00100000:2.0:1787076080.840995:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700838016 00000100:00100000:2.0:1787076080.840997:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700838016 00000100:00100000:2.0:1787076080.841011:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787076080.841016:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700837888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787076080.841051:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700837888:12345-0@lo:400:kworker.0 Request processed in 35us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076080.841057:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787076080.841067:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787076080.841072:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700838016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787076080.841095:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700838016:12345-0@lo:400:kworker.0 Request processed in 23us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076080.841100:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787076080.841116:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787076080.841121:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787076080.841162:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700838528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787076080.841197:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076080.841228:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700838528 00000100:00100000:2.0:1787076080.841232:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700838528 00000100:00100000:2.0:1787076080.841254:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787076080.841260:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700838528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787076080.841290:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787076080.841327:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700838528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076080.841333:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787076080.841367:0:3314:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787076080.841390:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700838528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787076080.841412:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700838016:0@lo:400:kworker.0 00000100:00100000:2.0:1787076080.841422:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700837888:0@lo:400:kworker.0 00000100:00100000:2.0:1787076080.841431:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1873884700838400:0@lo:400:kworker.0 00000100:00100000:2.0:1787076080.841456:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51646941-6761-4bd4-bf4b-97125ced6c1b:3311:1873884700837760:0@lo:400:kworker.0 00000100:00100000:2.0:1787076080.841465:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1873884700838272:0@lo:400:kworker.0 00000100:00100000:2.0:1787076080.841475:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873884700838144:0@lo:400:kworker.0 00000001:00100000:0.0:1787076080.931129:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 703f1470-5b22-4bd9-b310-b8043c4ba269 00010000:00010000:1.0:1787076081.096178:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787076081.406046:0:6728:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 703f1470-5b22-4bd9-b310-b8043c4ba269 00010000:00010000:1.0:1787076082.123467:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787076082.464436:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076082.464700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076082.464798:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678830464 00000100:00100000:0.0:1787076082.464808:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678830464 00000100:00100000:0.0:1787076082.464902:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:0.0:1787076082.464913:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+6:2359:x1873884678830464:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787076082.464986:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+6:2359:x1873884678830464:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 75us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076082.464994:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:3.0:1787076082.465552:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678830336 00000100:00100000:3.0:1787076082.465560:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678830336 00000100:00100000:3.0:1787076082.465605:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 105 00000100:00100000:3.0:1787076082.465614:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+13:2359:x1873884678830336:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787076082.465766:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+13:2359:x1873884678830336:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 75us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076082.465775:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 105 00000100:00080000:2.0:1787076082.466301:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787076082.474188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076082.474237:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076082.474323:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678830720 00000100:00100000:3.0:1787076082.474334:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678830720 00000100:00100000:2.0:1787076082.474374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076082.476146:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678830848 00000100:00100000:1.0:1787076082.476159:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678830848 00000100:00100000:1.0:1787076082.476436:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:1.0:1787076082.476449:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:703f1470-5b22-4bd9-b310-b8043c4ba269+6:2359:x1873884678830848:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787076082.476532:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:703f1470-5b22-4bd9-b310-b8043c4ba269+6:2359:x1873884678830848:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 86us (2294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076082.476553:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:3.0:1787076082.479514:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678830592 00000100:00100000:3.0:1787076082.479529:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678830592 00000100:00080000:3.0:1787076082.479939:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787076082.479946:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787076082.480184:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:0.0:1787076082.480207:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+5:2360:x1873884678830720:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787076082.480515:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+5:2360:x1873884678830720:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 319us (6337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076082.480524:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:0.0:1787076082.480665:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:0.0:1787076082.480689:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+5:2360:x1873884678830592:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787076082.480718:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+5:2360:x1873884678830592:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 31us (6344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076082.480725:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:2.0:1787076082.482681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076082.482710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:3.0:1787076082.482997:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787076082.483422:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678830976 00000100:00100000:1.0:1787076082.483434:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678830976 00000100:00100000:1.0:1787076082.483498:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678831104 00000100:00100000:1.0:1787076082.483501:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678831104 00000100:00100000:1.0:1787076082.483523:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:1.0:1787076082.483532:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:703f1470-5b22-4bd9-b310-b8043c4ba269+5:2360:x1873884678830976:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787076082.483616:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:703f1470-5b22-4bd9-b310-b8043c4ba269+5:2360:x1873884678830976:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 84us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076082.483625:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:1.0:1787076082.483666:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:1.0:1787076082.483673:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:703f1470-5b22-4bd9-b310-b8043c4ba269+5:2359:x1873884678831104:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787076082.483697:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:703f1470-5b22-4bd9-b310-b8043c4ba269+5:2359:x1873884678831104:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 25us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076082.483703:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00080000:3.0:1787076082.483988:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787076082.483992:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787076083.155788:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787076084.114377:0:16453:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc24524b20 20000000:00000080:0.0:1787076084.114395:0:16453:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff996082007000 uarg=0000000000000000 20000000:01000000:0.0:1787076084.114433:0:16453:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787076084.114440:0:16453:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787076084.114445:0:16453:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787076084.116146:0:16454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787076084.116333:0:16453:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787076084.129097:0:16453:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787076084.129131:0:16453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9961c1840e00/0x859911ad686a0908 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076084.129151:0:16453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9961bfe69600/0x859911ad686a05ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a05f8 expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076084.129212:0:16453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9961bf632e00/0x859911ad686a064c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a0645 expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076084.129220:0:16453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181522800/0x859911ad686a0787 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a0780 expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076084.129229:0:16453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff996181522e00/0x859911ad686a08a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76237f2 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076084.129236:0:16453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9961c1841c00/0x859911ad686a08de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623854 expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076084.129243:0:16453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9961c1840e00/0x859911ad686a0908 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076084.129344:0:16453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9961c1841c00/0x859911ad686a08de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623854 expref: 12 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076084.129358:0:16453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9961c1841c00/0x859911ad686a08de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623854 expref: 12 pid: 14318 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076084.129393:0:16453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1873884700838656:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787076084.129513:0:16453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181522e00/0x859911ad686a08a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76237f2 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076084.129522:0:16453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996181522e00/0x859911ad686a08a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76237f2 expref: 12 pid: 14316 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076084.129531:0:16453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1873884700838784:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787076084.129568:0:16453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff996181522800/0x859911ad686a0787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad686a0780 expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076084.129577:0:16453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff996181522800/0x859911ad686a0787 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad686a0780 expref: 18 pid: 14316 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076084.129587:0:16453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1873884700838912:0@lo:104: 00000100:00100000:2.0:1787076084.129634:0:16453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787076084.129780:0:16453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9961bf632e00/0x859911ad686a064c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad686a0645 expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076084.129789:0:16453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9961bf632e00/0x859911ad686a064c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad686a0645 expref: 18 pid: 14318 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076084.129801:0:16453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00ff100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1873884700839040:0@lo:104: 00000100:00100000:1.0:1787076084.129843:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700838912 00000100:00100000:1.0:1787076084.129852:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700838912 00000100:00100000:1.0:1787076084.129910:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787076084.129928:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51646941-6761-4bd4-bf4b-97125ced6c1b+3:16453:x1873884700838912:12345-0@lo:104: 00010000:00010000:1.0:1787076084.129941:0:14308:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9961c1841a00/0x859911ad686a0780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad686a0787 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.129998:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787076084.130005:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51646941-6761-4bd4-bf4b-97125ced6c1b+3:16453:x1873884700838912:12345-0@lo:104: Request processed in 79us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076084.130012:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787076084.130042:0:16041:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787076084.130048:0:16041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9961c1841a00/0x859911ad686a0780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad686a0787 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.130055:0:16041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841a00 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787076084.130059:0:16041:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9961c1841a00/0x859911ad686a0780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad686a0787 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.130067:0:16041:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9961c1841a00/0x859911ad686a0780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad686a0787 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787076084.130074:0:16041:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9961c1841a00/0x859911ad686a0780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad686a0787 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787076084.130078:0:16041:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787076084.130114:0:16041:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9961c1841a00/0x859911ad686a0780 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a0787 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.130120:0:16041:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787076084.130141:0:16041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9961c1841a00/0x859911ad686a0780 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a0787 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.130147:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9961c1841a00/0x859911ad686a0780 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a0787 expref: -99 pid: 15735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.130158:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076084.130160:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076084.130162:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787076084.130169:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787076084.130180:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51646941-6761-4bd4-bf4b-97125ced6c1b:3312:1873884700839168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787076084.130208:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076084.130315:0:16453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787076084.130350:0:16453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9961bfe69600/0x859911ad686a05ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x859911ad686a05f8 expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076084.130369:0:16453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9961bfe69600/0x859911ad686a05ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x859911ad686a05f8 expref: 18 pid: 14316 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076084.130379:0:16453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1845180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1873884700839296:0@lo:104: 00000100:00100000:3.0:1787076084.130407:0:16453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076084.130419:0:16453:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961894a29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787076084.130445:0:16453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1873884700838912:0@lo:104: 00000100:00100000:2.0:1787076084.131758:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700839168 00000100:00100000:2.0:1787076084.131767:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700839168 00010000:00010000:2.0:1787076084.131799:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181522800/0x859911ad686a0787 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad686a0780 expref: 19 pid: 14316 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076084.131853:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787076084.131863:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51646941-6761-4bd4-bf4b-97125ced6c1b+19:3312:x1873884700839168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787076084.131876:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787076084.131883:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181522800/0x859911ad686a0787 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad686a0780 expref: 19 pid: 14316 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076084.131892:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181522800/0x859911ad686a0787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad686a0780 expref: 19 pid: 14316 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076084.131908:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181522800/0x859911ad686a0787 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad686a0780 expref: 19 pid: 14316 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076084.132317:0:14307:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787076084.132336:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700839040 00000100:00100000:1.0:1787076084.132341:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700839040 00000100:00100000:1.0:1787076084.132363:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700839296 00000100:00100000:1.0:1787076084.132365:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700839296 00000100:00100000:1.0:1787076084.132378:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787076084.132385:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51646941-6761-4bd4-bf4b-97125ced6c1b+4:16453:x1873884700839040:12345-0@lo:104: 00010000:00010000:1.0:1787076084.132397:0:14307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff996181522000/0x859911ad686a0645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad686a064c expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.132475:0:14307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787076084.132481:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51646941-6761-4bd4-bf4b-97125ced6c1b+4:16453:x1873884700839040:12345-0@lo:104: Request processed in 97us (2167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076084.132489:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787076084.132506:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787076084.132512:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51646941-6761-4bd4-bf4b-97125ced6c1b+3:16453:x1873884700839296:12345-0@lo:104: 00010000:00010000:1.0:1787076084.132519:0:14307:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9961bf632400/0x859911ad686a05f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad686a05ff expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.132555:0:14307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787076084.132560:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51646941-6761-4bd4-bf4b-97125ced6c1b+3:16453:x1873884700839296:12345-0@lo:104: Request processed in 50us (2153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076084.132566:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787076084.132606:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787076084.132612:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff996181522000/0x859911ad686a0645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad686a064c expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.132620:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522000 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787076084.132623:0:14312:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff996181522000/0x859911ad686a0645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad686a064c expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.132667:0:14312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff996181522000/0x859911ad686a0645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad686a064c expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787076084.132674:0:14312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff996181522000/0x859911ad686a0645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad686a064c expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787076084.132680:0:14312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787076084.132726:0:14312:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff996181522000/0x859911ad686a0645 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a064c expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.132732:0:14312:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787076084.132751:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff996181522000/0x859911ad686a0645 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a064c expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.132758:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff996181522000/0x859911ad686a0645 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a064c expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.132772:0:14312:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787076084.132776:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9961bf632400/0x859911ad686a05f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x859911ad686a05ff expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.132781:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961bf632400 already unused, calling callback (ffffffffc1bacc20) 10000000:00010000:1.0:1787076084.132784:0:14312:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9961bf632400/0x859911ad686a05f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x859911ad686a05ff expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.132790:0:14312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9961bf632400/0x859911ad686a05f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x859911ad686a05ff expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787076084.132796:0:14312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9961bf632400/0x859911ad686a05f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x859911ad686a05ff expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787076084.132808:0:14312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787076084.132830:0:14312:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9961bf632400/0x859911ad686a05f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a05ff expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.132836:0:14312:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787076084.132860:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9961bf632400/0x859911ad686a05f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a05ff expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.132868:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9961bf632400/0x859911ad686a05f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x859911ad686a05ff expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.132882:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076084.132883:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076084.132885:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787076084.132903:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51646941-6761-4bd4-bf4b-97125ced6c1b:3312:1873884700839424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787076084.132954:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787076084.133054:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787076084.133095:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51646941-6761-4bd4-bf4b-97125ced6c1b+18:3312:x1873884700839168:12345-0@lo:103:ldlm_bl.0 Request processed in 1232us (2884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076084.133102:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787076084.133113:0:16453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00ff100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1873884700839040:0@lo:104: 00000100:00100000:2.0:1787076084.133116:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700839424 00000100:00100000:2.0:1787076084.133120:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700839424 00000100:00100000:3.0:1787076084.133122:0:16453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1845180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1873884700839296:0@lo:104: 00010000:00010000:2.0:1787076084.133134:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9961bf632e00/0x859911ad686a064c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad686a0645 expref: 18 pid: 14318 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076084.133201:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787076084.133209:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51646941-6761-4bd4-bf4b-97125ced6c1b+18:3312:x1873884700839424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787076084.133218:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787076084.133223:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9961bf632e00/0x859911ad686a064c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad686a0645 expref: 18 pid: 14318 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076084.133232:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9961bf632e00/0x859911ad686a064c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad686a0645 expref: 18 pid: 14318 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076084.133250:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961bf632e00/0x859911ad686a064c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad686a0645 expref: 18 pid: 14318 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076084.133259:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787076084.133283:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51646941-6761-4bd4-bf4b-97125ced6c1b+17:3312:x1873884700839424:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076084.133290:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787076084.133341:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51646941-6761-4bd4-bf4b-97125ced6c1b:3312:1873884700839424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787076084.133349:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51646941-6761-4bd4-bf4b-97125ced6c1b:3312:1873884700839168:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787076084.133478:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787076084.135385:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076084.135457:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678831232 00000100:00100000:0.0:1787076084.135465:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678831232 00000100:00100000:3.0:1787076084.135471:0:16453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1873884700838656:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787076084.135487:0:16453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1873884700838784:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787076084.135501:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff996181522e00/0x859911ad686a08a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76237f2 expref: 13 pid: 14316 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076084.135527:0:16453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9961c1840e00/0x859911ad686a0908 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076084.135528:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:0.0:1787076084.135542:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bba09050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b749548-aa04-4561-b46c-adb589deaa28+13:2362:x1873884678831232:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787076084.135555:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787076084.135561:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff996181522e00/0x859911ad686a08a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76237f2 expref: 13 pid: 14316 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076084.135571:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff996181522e00/0x859911ad686a08a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76237f2 expref: 13 pid: 14316 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076084.135587:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff996181522e00/0x859911ad686a08a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76237f2 expref: 13 pid: 14316 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076084.135615:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787076084.135840:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51646941-6761-4bd4-bf4b-97125ced6c1b:3313:1873884700839552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787076084.135860:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bba09050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b749548-aa04-4561-b46c-adb589deaa28+12:2362:x1873884678831232:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 319us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076084.135869:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:2.0:1787076084.136028:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076084.136282:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700839552 00000100:00100000:3.0:1787076084.136288:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700839552 00010000:00010000:3.0:1787076084.136315:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9961bfe69600/0x859911ad686a05ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad686a05f8 expref: 17 pid: 14316 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076084.136340:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787076084.136346:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51646941-6761-4bd4-bf4b-97125ced6c1b+17:3313:x1873884700839552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787076084.136354:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787076084.136358:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9961bfe69600/0x859911ad686a05ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x859911ad686a05f8 expref: 17 pid: 14316 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076084.136367:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9961bfe69600/0x859911ad686a05ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x859911ad686a05f8 expref: 17 pid: 14316 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076084.136386:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961bfe69600/0x859911ad686a05ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x859911ad686a05f8 expref: 17 pid: 14316 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076084.136395:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787076084.136434:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51646941-6761-4bd4-bf4b-97125ced6c1b+16:3313:x1873884700839552:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076084.136441:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787076084.136531:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51646941-6761-4bd4-bf4b-97125ced6c1b:3313:1873884700839552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787076084.147724:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076084.147851:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678831360 00000100:00100000:3.0:1787076084.147870:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678831360 00010000:00010000:3.0:1787076084.147934:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9961c1841c00/0x859911ad686a08de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623854 expref: 12 pid: 14318 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076084.148058:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:3.0:1787076084.148071:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b749548-aa04-4561-b46c-adb589deaa28+12:2362:x1873884678831360:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787076084.148093:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787076084.148100:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9961c1841c00/0x859911ad686a08de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623854 expref: 12 pid: 14318 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076084.148115:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9961c1841c00/0x859911ad686a08de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623854 expref: 12 pid: 14318 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076084.148138:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961c1841c00/0x859911ad686a08de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623854 expref: 12 pid: 14318 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076084.148160:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9961c1840e00/0x859911ad686a0908 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076084.148171:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961c1840e00/0x859911ad686a0908 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076084.148209:0:14309:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9961c1840e00/0x859911ad686a0908 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076084.148230:0:14309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9961c1840e00/0x859911ad686a0908 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076084.148237:0:14309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9961c1840e00/0x859911ad686a0908 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076084.148245:0:14309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9961c1840e00/0x859911ad686a0908 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076084.148253:0:14309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840e00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:3.0:1787076084.148257:0:14309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9961c1840e00/0x859911ad686a0908 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076084.148267:0:14309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9961c1840e00/0x859911ad686a0908 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076084.148293:0:14309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9961c1840e00/0x859911ad686a0908 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076084.148321:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787076084.148404:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b749548-aa04-4561-b46c-adb589deaa28+11:2362:x1873884678831360:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 335us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076084.148415:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00010000:00010000:1.0:1787076084.148629:0:16453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9961c1840e00/0x859911ad686a0908 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.148667:0:16453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9961c1840e00/0x859911ad686a0908 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.148694:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9961c1840e00/0x859911ad686a0908 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076084.168743:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787076084.430460:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700839680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787076084.430538:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076084.431136:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700839680 00000100:00100000:1.0:1787076084.431145:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700839680 00000100:00100000:1.0:1787076084.431224:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787076084.431234:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700839680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787076084.431270:0:15011:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787076084.431456:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700839680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 223us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076084.431463:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787076084.431521:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700839680:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787076084.431566:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787076085.205303:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787076085.469458:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076085.469541:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678831488 00000100:00100000:2.0:1787076085.469552:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678831488 00000100:00100000:2.0:1787076085.469614:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 106 00000100:00100000:2.0:1787076085.469624:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+11:13753:x1873884678831488:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787076085.469682:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787076085.469704:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961c1840000/0x859911ad686a090f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623885 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076085.469739:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961c1840000/0x859911ad686a090f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623885 expref: 12 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076085.469752:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961c1840000/0x859911ad686a090f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623885 expref: 12 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076085.469772:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1840000, rc 0) 00000100:00100000:2.0:1787076085.469840:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+12:13753:x1873884678831488:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 217us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076085.469861:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 106 00000100:00100000:1.0:1787076085.480917:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076085.481861:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678831616 00000100:00100000:2.0:1787076085.481875:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678831616 00000100:00100000:2.0:1787076085.481937:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 107 00000100:00100000:2.0:1787076085.481949:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a4c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b749548-aa04-4561-b46c-adb589deaa28+12:13753:x1873884678831616:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787076085.482254:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a4c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b749548-aa04-4561-b46c-adb589deaa28+12:13753:x1873884678831616:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 306us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076085.482263:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 107 00000100:00100000:0.0:1787076085.494442:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076085.494693:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678831744 00000100:00100000:3.0:1787076085.494705:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678831744 00000100:00100000:3.0:1787076085.494767:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 108 00000100:00100000:3.0:1787076085.494777:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996190f62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+12:13753:x1873884678831744:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787076085.495904:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996190f62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+12:13753:x1873884678831744:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 503us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076085.500491:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 108 00000100:00100000:0.0:1787076085.507894:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076085.508360:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678831872 00000100:00100000:2.0:1787076085.508376:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678831872 00000100:00100000:2.0:1787076085.508440:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 109 00000100:00100000:2.0:1787076085.508451:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996190f60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+12:13753:x1873884678831872:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787076085.508469:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787076085.508492:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9961c1840200/0x859911ad686a0916 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762388c expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076085.508523:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9961c1840200/0x859911ad686a0916 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762388c expref: 13 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076085.508536:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9961c1840200/0x859911ad686a0916 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762388c expref: 13 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076085.508545:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1840200, rc 0) 00000100:00100000:2.0:1787076085.508617:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996190f60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+13:13753:x1873884678831872:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 166us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076085.508624:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 109 00000100:00100000:1.0:1787076085.516107:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076085.516764:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678832000 00000100:00100000:3.0:1787076085.516776:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678832000 00000100:00100000:3.0:1787076085.516838:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 110 00000100:00100000:3.0:1787076085.516849:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996190f63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+13:13753:x1873884678832000:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787076085.517156:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996190f63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b749548-aa04-4561-b46c-adb589deaa28+13:13753:x1873884678832000:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 307us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076085.517164:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 110 00000100:00100000:1.0:1787076085.530556:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076085.543002:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678832128 00000100:00100000:0.0:1787076085.543022:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678832128 00000100:00100000:0.0:1787076085.543158:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 111 00000100:00100000:0.0:1787076085.543172:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b749548-aa04-4561-b46c-adb589deaa28+13:13753:x1873884678832128:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787076085.545069:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b749548-aa04-4561-b46c-adb589deaa28+13:13753:x1873884678832128:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 1893us (14926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076085.545082:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 111 10000000:01000000:2.0:1787076085.639714:0:14321:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787076085.639722:0:14321:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff996082dcd000 from 10 10000000:01000000:2.0:1787076085.639728:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787076085.639774:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961c1841800/0x859911ad686a091d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076085.639786:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9961c1841800/0x859911ad686a091d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076085.639797:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9961c1841800/0x859911ad686a091d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076085.639824:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700839808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787076085.639888:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076085.639941:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961894a29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787076085.640013:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700839808 00000100:00100000:1.0:1787076085.640021:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700839808 00000100:00100000:1.0:1787076085.640077:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787076085.640087:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+16:14321:x1873884700839808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787076085.640110:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787076085.640125:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996190038600/0x859911ad686a0924 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a091d expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076085.640149:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996190038600/0x859911ad686a0924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a091d expref: 17 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076085.640160:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996190038600/0x859911ad686a0924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a091d expref: 17 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076085.640177:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190038600, rc 0) 00000100:00100000:1.0:1787076085.640219:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+17:14321:x1873884700839808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076085.640227:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787076085.640272:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700839808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787076085.640285:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9961c1841800/0x859911ad686a091d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0924 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076085.640295:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9961c1841800/0x859911ad686a091d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a0924 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076085.640349:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700839936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787076085.640375:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076085.640389:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eebd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787076085.640401:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700839936 00000100:00100000:1.0:1787076085.640404:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700839936 00000100:00100000:1.0:1787076085.640424:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787076085.640430:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+17:14321:x1873884700839936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787076085.640694:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+17:14321:x1873884700839936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076085.640703:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787076085.640731:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700839936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787076085.640761:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700840064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787076085.640798:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076085.640816:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eebd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787076085.640826:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700840064 00000100:00100000:1.0:1787076085.640829:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700840064 00000100:00100000:1.0:1787076085.640846:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787076085.640852:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+17:14321:x1873884700840064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787076085.640980:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+17:14321:x1873884700840064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076085.640987:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787076085.641018:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700840064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787076085.641622:0:16515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787076085.641705:0:14321:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787076085.641721:0:14321:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787076085.641729:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9961c1841800/0x859911ad686a091d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0924 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076085.641739:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9961c1841800/0x859911ad686a091d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0924 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787076085.641748:0:14321:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787076085.641750:0:14321:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9961bf087000 from 10 10000000:01000000:1.0:1787076085.641753:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787076085.641778:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190039c00/0x859911ad686a092b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076085.641785:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff996190039c00/0x859911ad686a092b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076085.641793:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff996190039c00/0x859911ad686a092b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076085.641818:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700840192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787076085.641850:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076085.641867:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eeb840 going to sleep for 11 seconds 00000100:00100000:1.0:1787076085.641882:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700840192 00000100:00100000:1.0:1787076085.641886:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700840192 00000100:00100000:1.0:1787076085.641909:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787076085.641915:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+17:14321:x1873884700840192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787076085.641923:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787076085.641934:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996190039e00/0x859911ad686a0932 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a092b expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076085.641951:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996190039e00/0x859911ad686a0932 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a092b expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076085.641960:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996190039e00/0x859911ad686a0932 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a092b expref: 18 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076085.641967:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190039e00, rc 0) 00000100:00100000:1.0:1787076085.641996:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+18:14321:x1873884700840192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076085.642004:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787076085.642039:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700840192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787076085.642051:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff996190039c00/0x859911ad686a092b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0932 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076085.642059:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff996190039c00/0x859911ad686a092b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a0932 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076085.642104:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700840320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787076085.642128:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076085.642141:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eeb840 going to sleep for 11 seconds 00000100:00100000:1.0:1787076085.642152:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700840320 00000100:00100000:1.0:1787076085.642155:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700840320 00000100:00100000:1.0:1787076085.642172:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787076085.642178:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+18:14321:x1873884700840320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787076085.642363:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+18:14321:x1873884700840320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076085.642369:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787076085.642398:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700840320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787076085.642420:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700840448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787076085.642454:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076085.642469:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eeb840 going to sleep for 11 seconds 00000100:00100000:1.0:1787076085.642480:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700840448 00000100:00100000:1.0:1787076085.642484:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700840448 00000100:00100000:1.0:1787076085.642502:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787076085.642507:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+18:14321:x1873884700840448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787076085.642622:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+18:14321:x1873884700840448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076085.642628:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787076085.642700:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700840448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787076085.646927:0:16516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787076085.647047:0:14321:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787076085.647068:0:14321:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787076085.647079:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff996190039c00/0x859911ad686a092b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0932 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076085.647093:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff996190039c00/0x859911ad686a092b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0932 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787076085.647176:0:14321:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787076085.647180:0:14321:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9961893b3000 from 10 10000000:01000000:0.0:1787076085.647183:0:14321:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787076085.647222:0:14321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff99608125d600/0x859911ad686a0939 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076085.647243:0:14321:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff99608125d600/0x859911ad686a0939 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076085.647257:0:14321:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff99608125d600/0x859911ad686a0939 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076085.647284:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700840576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787076085.647356:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076085.647394:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff996183ee8180 going to sleep for 11 seconds 00000100:00100000:1.0:1787076085.647523:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700840576 00000100:00100000:1.0:1787076085.647536:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700840576 00000100:00100000:1.0:1787076085.647591:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787076085.647600:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+18:14321:x1873884700840576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787076085.647614:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787076085.647627:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff996190039000/0x859911ad686a0940 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x859911ad686a0939 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076085.647679:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff996190039000/0x859911ad686a0940 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x859911ad686a0939 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076085.647689:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff996190039000/0x859911ad686a0940 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x859911ad686a0939 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076085.647699:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190039000, rc 0) 00000100:00100000:1.0:1787076085.647746:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+19:14321:x1873884700840576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076085.647753:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787076085.648217:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700840576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787076085.648236:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff99608125d600/0x859911ad686a0939 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0940 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076085.648246:0:14321:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff99608125d600/0x859911ad686a0939 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x859911ad686a0940 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076085.648300:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff996184e8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700840704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787076085.648330:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076085.648358:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff996183ee8180 going to sleep for 11 seconds 00000100:00100000:1.0:1787076085.649577:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700840704 00000100:00100000:1.0:1787076085.649586:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700840704 00000100:00100000:0.0:1787076085.650582:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787076085.650596:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+19:14321:x1873884700840704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787076085.650992:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51646941-6761-4bd4-bf4b-97125ced6c1b+19:14321:x1873884700840704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 399us (2660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076085.651002:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787076085.653250:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff996184e8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700840704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787076085.653321:0:14321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700840832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787076085.653393:0:14321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076085.654376:0:14321:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961894a2300 going to sleep for 11 seconds 00000100:00100000:0.0:1787076085.658829:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700840832 00000100:00100000:0.0:1787076085.658853:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700840832 00000100:00100000:0.0:1787076085.658913:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787076085.658924:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+19:14321:x1873884700840832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787076085.659280:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51646941-6761-4bd4-bf4b-97125ced6c1b+19:14321:x1873884700840832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 358us (5886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076085.659289:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787076085.659561:0:14321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51646941-6761-4bd4-bf4b-97125ced6c1b:14321:1873884700840832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787076085.662061:0:16520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787076085.662268:0:14321:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787076085.662291:0:14321:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787076085.662302:0:14321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff99608125d600/0x859911ad686a0939 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0940 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076085.662314:0:14321:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff99608125d600/0x859911ad686a0939 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x859911ad686a0940 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076085.960024:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700841088:0@lo:400:kworker.0 00000100:00100000:1.0:1787076085.960099:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076085.960156:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787076085.960162:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700840960:0@lo:400:kworker.0 00000100:00100000:1.0:1787076085.960184:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076085.960201:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700841472:0@lo:400:kworker.0 00000100:00100000:1.0:1787076085.960225:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076085.960252:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700841216:0@lo:400:kworker.0 00000100:00100000:1.0:1787076085.960276:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076085.960307:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787076085.960313:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700841344:0@lo:400:kworker.0 00000100:00100000:1.0:1787076085.960335:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076085.960372:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700841088 00000100:00100000:1.0:1787076085.960380:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700841088 00000100:00100000:1.0:1787076085.960438:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700840960 00000100:00100000:1.0:1787076085.960441:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700840960 00000100:00100000:1.0:1787076085.960457:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787076085.960465:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700841088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787076085.960519:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700841088:12345-0@lo:400:kworker.0 Request processed in 54us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076085.960527:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787076085.960547:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787076085.960553:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700840960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787076085.960582:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700840960:12345-0@lo:400:kworker.0 Request processed in 30us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076085.960588:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787076085.960609:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700841472 00000100:00100000:1.0:1787076085.960612:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700841472 00000100:00100000:1.0:1787076085.960637:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700841216 00000100:00100000:1.0:1787076085.960685:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700841216 00000100:00100000:1.0:1787076085.960699:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700841344 00000100:00100000:1.0:1787076085.960701:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700841344 00000100:00100000:1.0:1787076085.960716:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787076085.960724:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700841472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787076085.960754:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700841472:12345-0@lo:400:kworker.0 Request processed in 32us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076085.960760:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787076085.960778:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787076085.960783:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700841216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787076085.960830:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700841216:12345-0@lo:400:kworker.0 Request processed in 46us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076085.960836:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787076085.960846:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787076085.960852:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700841344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787076085.960875:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1873884700841344:12345-0@lo:400:kworker.0 Request processed in 24us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076085.960880:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787076085.960901:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787076085.960905:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787076085.960937:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1873884700841344:0@lo:400:kworker.0 00000100:00100000:1.0:1787076085.960949:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700841216:0@lo:400:kworker.0 00000100:00100000:1.0:1787076085.960982:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700840960:0@lo:400:kworker.0 00000100:00100000:1.0:1787076085.960992:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700841472:0@lo:400:kworker.0 00000100:00100000:1.0:1787076085.960999:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700841088:0@lo:400:kworker.0 00000100:00100000:2.0:1787076085.961333:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787076085.961344:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700841600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787076085.961383:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076085.961415:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700841600 00000100:00100000:2.0:1787076085.961419:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700841600 00000100:00100000:2.0:1787076085.961448:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787076085.961462:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700841600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787076085.961492:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787076085.961529:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873884700841600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076085.961536:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787076085.961569:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1873884700841600:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787076086.220405:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076087.239995:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787076087.582999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076087.583174:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076087.583218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076087.583244:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076087.583267:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076087.583282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076087.583325:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076087.583343:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678832512 00000100:00100000:3.0:1787076087.583344:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678832768 00000100:00100000:3.0:1787076087.583353:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678832768 00000100:00100000:1.0:1787076087.583353:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678832512 00000100:00100000:3.0:1787076087.583413:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678832384 00000100:00100000:3.0:1787076087.583416:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678832384 00000100:00100000:2.0:1787076087.583439:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678833024 00000100:00100000:2.0:1787076087.583444:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678833024 00000100:00100000:0.0:1787076087.583576:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678832256 00000100:00100000:0.0:1787076087.583580:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678832256 00000100:00100000:0.0:1787076087.583614:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 121 00000100:00100000:0.0:1787076087.583624:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+13:2360:x1873884678832256:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787076087.583741:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b749548-aa04-4561-b46c-adb589deaa28+13:2360:x1873884678832256:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 118us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076087.583749:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 121 00000100:00100000:0.0:1787076087.583802:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678832640 00000100:00100000:0.0:1787076087.583806:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678832640 00000100:00100000:1.0:1787076087.583933:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678832896 00000100:00100000:1.0:1787076087.583937:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678832896 00000100:00100000:1.0:1787076087.583956:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:1.0:1787076087.583963:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+5:2360:x1873884678832512:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787076087.583994:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+5:2360:x1873884678832512:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 32us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076087.584001:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:1.0:1787076087.584013:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:1.0:1787076087.584020:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:703f1470-5b22-4bd9-b310-b8043c4ba269+5:2360:x1873884678832896:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787076087.584043:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:703f1470-5b22-4bd9-b310-b8043c4ba269+5:2360:x1873884678832896:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 24us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076087.584049:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:1.0:1787076087.584302:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:1.0:1787076087.584311:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:703f1470-5b22-4bd9-b310-b8043c4ba269+6:2360:x1873884678832768:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787076087.584464:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:703f1470-5b22-4bd9-b310-b8043c4ba269+6:2360:x1873884678832768:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 37us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076087.584473:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00080000:1.0:1787076087.584527:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787076087.584531:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787076087.584534:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787076087.584664:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:2.0:1787076087.584673:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:703f1470-5b22-4bd9-b310-b8043c4ba269+5:2360:x1873884678833024:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787076087.584707:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:703f1470-5b22-4bd9-b310-b8043c4ba269+5:2360:x1873884678833024:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 36us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076087.584714:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:0.0:1787076087.584855:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:0.0:1787076087.584862:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+5:2360:x1873884678832640:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787076087.584889:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:0.0:1787076087.584889:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+5:2360:x1873884678832640:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 27us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076087.584896:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+6:2360:x1873884678832384:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787076087.584905:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:3.0:1787076087.585244:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+6:2360:x1873884678832384:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 346us (1974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076087.585251:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:1.0:1787076087.912988:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076087.913080:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678833152 00000100:00100000:2.0:1787076087.913093:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678833152 00000100:00100000:2.0:1787076087.913174:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:2.0:1787076087.913184:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+6:14410:x1873884678833152:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787076087.913207:0:15531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787076087.913244:0:15531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0947 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623893 expref: -99 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.913320:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a094e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.913335:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a094e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.913365:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a094e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.913384:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0955 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.913392:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0955 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.913398:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0955 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.913920:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840a00/0x859911ad686a095c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.913930:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840a00/0x859911ad686a095c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.913937:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840a00/0x859911ad686a095c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787076087.914021:0:15531:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787076087.914025:0:15531:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787076087.914137:0:15531:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840a00/0x859911ad686a095c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.914148:0:15531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a094e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.914155:0:15531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a094e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.914172:0:15531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a094e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.914178:0:15531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787076087.914183:0:15531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a094e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.914191:0:15531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a094e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.914203:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b79300) 00010000:00010000:2.0:1787076087.914206:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787076087.914211:0:15531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a094e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.914217:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a094e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.914229:0:15531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0955 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.914235:0:15531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0955 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.914241:0:15531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0955 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.914246:0:15531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787076087.914249:0:15531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0955 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.914265:0:15531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0955 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.914274:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff996191b79900) 00010000:00010000:2.0:1787076087.914277:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787076087.914280:0:15531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0955 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.914291:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0955 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.914327:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841000/0x859911ad686a0947 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623893 expref: 8 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.914342:0:15531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840a00/0x859911ad686a095c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623893 expref: 7 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076087.914348:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff996191b79000) 00010000:00010000:2.0:1787076087.914351:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787076087.914353:0:15531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1840a00, rc 0) 00000100:00100000:2.0:1787076087.914433:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+7:14410:x1873884678833152:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1249us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076087.914442:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:2.0:1787076087.938705:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076087.938881:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678833408 00000100:00100000:3.0:1787076087.938920:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678833408 00000100:00100000:3.0:1787076087.938986:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:3.0:1787076087.938997:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+7:14410:x1873884678833408:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787076087.939018:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787076087.939044:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0963 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762389a expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.939123:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a096a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.939139:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a096a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.939163:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a096a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.939179:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a0971 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.939186:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a0971 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.939193:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a0971 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.939775:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522e00/0x859911ad686a0978 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.939788:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522e00/0x859911ad686a0978 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.939795:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522e00/0x859911ad686a0978 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787076087.939817:0:14325:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787076087.940100:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a096a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.940108:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a096a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.940114:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a096a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.940120:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787076087.940125:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a096a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.940133:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a096a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.940146:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff996191b79000) 00010000:00010000:3.0:1787076087.940149:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787076087.940154:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a096a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.940160:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a096a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.940173:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a0971 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.940178:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a0971 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.940194:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a0971 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.940199:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787076087.940201:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a0971 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.940208:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a0971 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.940218:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff996194304e00) 00010000:00010000:3.0:1787076087.940220:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787076087.940222:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a0971 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.940227:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a0971 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.940614:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0963 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762389a expref: 10 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.940682:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522e00/0x859911ad686a0978 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762389a expref: 9 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.940690:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996194304a00) 00010000:00010000:3.0:1787076087.940693:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787076087.940695:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522e00, rc 0) 00000100:00100000:3.0:1787076087.940782:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+9:14410:x1873884678833408:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1785us (2085us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787076087.940801:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:1.0:1787076087.960993:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076087.961129:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678833536 00000100:00100000:2.0:1787076087.961140:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678833536 00000100:00100000:2.0:1787076087.961246:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:2.0:1787076087.961258:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+9:14410:x1873884678833536:12345-192.168.204.50@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787076087.961388:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+9:14410:x1873884678833536:12345-192.168.204.50@tcp:59:lhsmtool_posix.0 Request processed in 132us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076087.961396:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:0.0:1787076087.985912:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076087.986016:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678833664 00000100:00100000:3.0:1787076087.986026:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678833664 00000100:00100000:3.0:1787076087.986097:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:3.0:1787076087.986116:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+9:14416:x1873884678833664:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787076087.986139:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787076087.986159:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0986 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76238a1 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986464:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a098d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986491:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a098d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986505:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a098d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986522:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a0994 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986529:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a0994 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986536:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a0994 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986850:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a098d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986870:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a098d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986877:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a098d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986883:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787076087.986888:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a098d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986895:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a098d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986908:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b79300) 00010000:00010000:3.0:1787076087.986911:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787076087.986916:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a098d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986921:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a098d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986935:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a0994 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986940:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a0994 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986945:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a0994 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986950:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787076087.986959:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a0994 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986966:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a0994 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986974:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff996194304e00) 00010000:00010000:3.0:1787076087.986977:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787076087.986979:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a0994 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.986985:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a0994 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.987023:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0986 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238a1 expref: 10 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.987034:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b79300) 00010000:00010000:3.0:1787076087.987036:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787076087.987040:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0986 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238a1 expref: 10 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076087.987050:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522200, rc 0) 00000100:00100000:3.0:1787076087.987612:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+9:14416:x1873884678833664:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1495us (1707us total) trans 0 rc 301/301 00000100:00100000:3.0:1787076087.987631:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:3.0:1787076088.004916:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076088.005913:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678833792 00000100:00100000:0.0:1787076088.005927:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678833792 00000100:00100000:0.0:1787076088.006006:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:0.0:1787076088.006018:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:68657535-b9e1-4ead-a295-31f2243e0fc4+9:14416:x1873884678833792:12345-192.168.204.50@tcp:700:lfs.0 00000100:00100000:0.0:1787076088.006125:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:68657535-b9e1-4ead-a295-31f2243e0fc4+9:14416:x1873884678833792:12345-192.168.204.50@tcp:700:lfs.0 Request processed in 109us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076088.006143:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:0.0:1787076088.013355:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076088.013581:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678834048 00000100:00100000:1.0:1787076088.013603:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678834048 00000100:00100000:1.0:1787076088.013721:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:1.0:1787076088.013733:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+9:14416:x1873884678834048:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:1.0:1787076088.013789:0:15531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787076088.013818:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a08c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762381c expref: 9 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.013837:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b79300) 00010000:00010000:1.0:1787076088.013842:0:15531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787076088.014110:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a099b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.014125:0:15531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0901 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762387e expref: 5 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.014145:0:15531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a099b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.014179:0:15531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0901 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762387e expref: 5 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.014193:0:15531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0901 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762387e expref: 5 pid: 14324 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076088.014207:0:15531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15531:1873884700841728:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787076088.014302:0:15531:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eebc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787076088.019917:0:15531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15531:1873884700841728:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787076088.019956:0:15531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a099b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076088.021789:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076088.021966:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678834176 00000100:00100000:3.0:1787076088.021978:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678834176 00010000:00010000:3.0:1787076088.022030:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0901 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762387e expref: 6 pid: 14324 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076088.022149:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:3.0:1787076088.022160:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:703f1470-5b22-4bd9-b310-b8043c4ba269+6:2362:x1873884678834176:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787076088.022176:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787076088.022184:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0901 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762387e expref: 6 pid: 14324 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.022196:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0901 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762387e expref: 6 pid: 14324 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.022217:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0901 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762387e expref: 6 pid: 14324 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.022246:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b79300) 00010000:00010000:3.0:1787076088.022252:0:14311:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a099b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.022262:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a099b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.022269:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a099b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.022300:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787076088.022380:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:703f1470-5b22-4bd9-b310-b8043c4ba269+5:2362:x1873884678834176:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 222us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076088.022388:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00010000:00010000:1.0:1787076088.022605:0:15531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a099b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.022613:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a099b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.022685:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a09a2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.022695:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a09a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.022703:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a09a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787076088.024121:0:15531:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787076088.024135:0:15531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a099b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.024143:0:15531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a099b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.024150:0:15531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a099b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.024156:0:15531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787076088.024159:0:15531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a099b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.024167:0:15531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a099b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.024192:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996191b79300) 00010000:00010000:1.0:1787076088.024194:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787076088.024199:0:15531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a099b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.024204:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a099b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787076088.024223:0:15531:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 0000000046877cca reply state 00000000fd038c43 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a09a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076088.024232:0:15531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787076088.024310:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+10:14416:x1873884678834048:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 10577us (10964us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787076088.024319:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00010000:00010000:3.0:1787076088.032243:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a09a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.032276:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a09a2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.032285:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a09a2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.032293:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787076088.032298:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a09a2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.032307:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a09a2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.033952:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff996187c34900) 00010000:00010000:3.0:1787076088.033957:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787076088.033965:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a09a2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.033972:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a09a2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076088.138344:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076088.138530:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678834304 00000100:00100000:3.0:1787076088.138542:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678834304 00000100:00100000:3.0:1787076088.138607:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:3.0:1787076088.138627:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+9:14424:x1873884678834304:12345-192.168.204.50@tcp:101:lctl.0 00010000:00010000:3.0:1787076088.138681:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787076088.138708:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a09a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76238a8 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.138800:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a09b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.138815:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a09b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.138825:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a09b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787076088.138887:0:14325:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787076088.138891:0:14325:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787076088.138938:0:14325:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a09b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.138962:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a09a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238a8 expref: 11 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.138979:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523200/0x859911ad686a09b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238a8 expref: 10 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.138987:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996194304e00) 00010000:00010000:3.0:1787076088.138990:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787076088.138993:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523200, rc 0) 00000100:00100000:3.0:1787076088.139056:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+10:14424:x1873884678834304:12345-192.168.204.50@tcp:101:lctl.0 Request processed in 441us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076088.139063:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:2.0:1787076088.174889:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076088.184704:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678834432 00000100:00100000:1.0:1787076088.184722:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678834432 00000100:00100000:1.0:1787076088.184820:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:1.0:1787076088.184830:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:703f1470-5b22-4bd9-b310-b8043c4ba269+5:14425:x1873884678834432:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787076088.184852:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787076088.184876:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a09b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76238af expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.184936:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039a00/0x859911ad686a09be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.184950:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190039a00/0x859911ad686a09be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.184975:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190039a00/0x859911ad686a09be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787076088.185033:0:14323:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787076088.185036:0:14323:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787076088.185056:0:14323:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996190039a00/0x859911ad686a09be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.185078:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a09b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238af expref: 7 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.185096:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039a00/0x859911ad686a09be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238af expref: 6 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.185104:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996194304e00) 00010000:00010000:1.0:1787076088.185106:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787076088.185109:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190039a00, rc 0) 00000100:00100000:1.0:1787076088.185175:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:703f1470-5b22-4bd9-b310-b8043c4ba269+6:14425:x1873884678834432:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 346us (10295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076088.185182:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:0.0:1787076088.190451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076088.190994:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678834560 00000100:00100000:3.0:1787076088.191010:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678834560 00000100:00100000:3.0:1787076088.193436:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:3.0:1787076088.193466:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:703f1470-5b22-4bd9-b310-b8043c4ba269+6:14425:x1873884678834560:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787076088.193500:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787076088.193542:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a09c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76238b6 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.193674:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a09cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.193692:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a09cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.193705:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a09cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.193722:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad686a09d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.193729:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad686a09d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.193737:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad686a09d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.196803:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522000/0x859911ad686a09da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.196830:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522000/0x859911ad686a09da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.196842:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522000/0x859911ad686a09da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787076088.196934:0:14325:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787076088.196938:0:14325:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787076088.196965:0:14325:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996181522000/0x859911ad686a09da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.196980:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a09cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.196988:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a09cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.196995:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a09cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.197002:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181523800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787076088.197006:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a09cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.197012:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a09cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.197025:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996194304e00) 00010000:00010000:3.0:1787076088.197028:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787076088.197032:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a09cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.197038:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181523800/0x859911ad686a09cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.197054:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad686a09d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.197070:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad686a09d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.197076:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad686a09d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.197081:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787076088.199016:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad686a09d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.199040:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad686a09d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.199058:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff996194304500) 00010000:00010000:3.0:1787076088.199061:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787076088.199066:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad686a09d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.199074:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad686a09d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.199198:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a09c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238b6 expref: 8 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.199214:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522000/0x859911ad686a09da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238b6 expref: 7 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.199221:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996194304800) 00010000:00010000:3.0:1787076088.199224:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787076088.199244:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522000, rc 0) 00000100:00100000:3.0:1787076088.199326:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:703f1470-5b22-4bd9-b310-b8043c4ba269+7:14425:x1873884678834560:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 5875us (8888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076088.199336:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:0.0:1787076088.206890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076088.207411:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678834816 00000100:00100000:2.0:1787076088.207427:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678834816 00000100:00100000:2.0:1787076088.207592:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:2.0:1787076088.207607:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:703f1470-5b22-4bd9-b310-b8043c4ba269+7:14425:x1873884678834816:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787076088.207688:0:15531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787076088.207717:0:15531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a09e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76238bd expref: -99 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787076088.207892:0:15531:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787076088.208077:0:15531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a09e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238bd expref: 9 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.208095:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996194304e00) 00010000:00010000:2.0:1787076088.208099:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787076088.208105:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a09e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238bd expref: 9 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.208123:0:15531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1841e00, rc 0) 00000100:00100000:2.0:1787076088.208203:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:703f1470-5b22-4bd9-b310-b8043c4ba269+8:14425:x1873884678834816:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 598us (1326us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787076088.208212:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:2.0:1787076088.218926:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076088.219081:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678835072 00000100:00100000:1.0:1787076088.219096:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678835072 00000100:00100000:1.0:1787076088.219359:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:1.0:1787076088.219373:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b00fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:703f1470-5b22-4bd9-b310-b8043c4ba269+8:14425:x1873884678835072:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:1.0:1787076088.219529:0:14324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787076088.219566:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522000/0x859911ad686a09da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238b6 expref: 8 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.219606:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996194304800) 00010000:00010000:1.0:1787076088.219632:0:14324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787076088.223449:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99608125d800/0x859911ad686a09ef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076088.223540:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99608125d800/0x859911ad686a09ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076088.223557:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99608125d800/0x859911ad686a09ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787076088.224756:0:14324:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 0000000054160a42 reply state 000000002aafd260 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff99608125d800/0x859911ad686a09ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076088.224778:0:14324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787076088.224889:0:14324:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1787076088.225768:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b00fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:703f1470-5b22-4bd9-b310-b8043c4ba269+9:14425:x1873884678835072:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 6386us (6845us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787076088.225782:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 24 00010000:00010000:2.0:1787076088.232856:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99608125d800/0x859911ad686a09ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.232882:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99608125d800/0x859911ad686a09ef lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.232891:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99608125d800/0x859911ad686a09ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.232898:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125d800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787076088.232904:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99608125d800/0x859911ad686a09ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.232913:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99608125d800/0x859911ad686a09ef lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.232934:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996191325e00) 00010000:00010000:2.0:1787076088.232937:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787076088.232943:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99608125d800/0x859911ad686a09ef lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.232949:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99608125d800/0x859911ad686a09ef lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076088.234564:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076088.234698:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678835328 00000100:00100000:1.0:1787076088.234713:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678835328 00000100:00100000:1.0:1787076088.234784:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:1.0:1787076088.234795:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:703f1470-5b22-4bd9-b310-b8043c4ba269+8:14425:x1873884678835328:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1787076088.236736:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:703f1470-5b22-4bd9-b310-b8043c4ba269+9:14425:x1873884678835328:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 363us (1023us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787076088.236756:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:1.0:1787076088.241927:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076088.242052:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678835584 00000100:00100000:2.0:1787076088.242066:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678835584 00000100:00100000:2.0:1787076088.242194:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:2.0:1787076088.242206:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:703f1470-5b22-4bd9-b310-b8043c4ba269+9:14425:x1873884678835584:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787076088.242249:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787076088.242278:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a09f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76238c4 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.242417:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a09fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.242434:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a09fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.242447:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a09fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.242463:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.242470:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.242477:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787076088.242723:0:14323:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787076088.242858:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a09fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.242867:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a09fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.242874:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a09fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.242881:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840e00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787076088.242886:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a09fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.242908:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a09fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.242923:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996194304e00) 00010000:00010000:2.0:1787076088.242926:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787076088.242933:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a09fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.242940:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a09fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.242956:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.242962:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.242968:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.242974:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787076088.242977:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.242983:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.242990:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff996191b79900) 00010000:00010000:2.0:1787076088.242993:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787076088.242996:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.243012:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.243063:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a09f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238c4 expref: 11 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.243074:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996194304e00) 00010000:00010000:2.0:1787076088.243076:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787076088.243080:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a09f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238c4 expref: 11 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.243091:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1840800, rc 0) 00000100:00100000:2.0:1787076088.243170:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:703f1470-5b22-4bd9-b310-b8043c4ba269+10:14425:x1873884678835584:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 966us (1259us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787076088.243180:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:3.0:1787076088.247265:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076088.259537:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678835712 00000100:00100000:1.0:1787076088.259562:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678835712 00000100:00100000:1.0:1787076088.259919:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:1.0:1787076088.259934:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:703f1470-5b22-4bd9-b310-b8043c4ba269+10:14425:x1873884678835712:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787076088.259975:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787076088.260008:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0a12 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76238cb expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.260133:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0a19 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.260151:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0a19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.260902:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0a19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787076088.261007:0:14324:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787076088.261012:0:14324:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787076088.261042:0:14324:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0a19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.261083:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0a12 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238cb expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.261104:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0a19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238cb expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.261114:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996187c34c00) 00010000:00010000:1.0:1787076088.261117:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787076088.261121:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190038c00, rc 0) 00000100:00100000:1.0:1787076088.262815:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:703f1470-5b22-4bd9-b310-b8043c4ba269+11:14425:x1873884678835712:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1298us (13976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076088.262836:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 26 00010000:00010000:1.0:1787076088.265082:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787076088.267528:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076088.274499:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678835840 00000100:00100000:3.0:1787076088.274523:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678835840 00000100:00100000:0.0:1787076088.275085:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:0.0:1787076088.275100:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:703f1470-5b22-4bd9-b310-b8043c4ba269+11:14425:x1873884678835840:12345-192.168.204.50@tcp:37:lfs.0 00000100:00100000:1.0:1787076088.291209:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:703f1470-5b22-4bd9-b310-b8043c4ba269+11:14425:x1873884678835840:12345-192.168.204.50@tcp:37:lfs.0 Request processed in 16094us (23679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076088.291241:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:1.0:1787076088.299471:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076088.299586:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678836096 00000100:00100000:3.0:1787076088.299602:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678836096 00000100:00100000:2.0:1787076088.300091:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:2.0:1787076088.300108:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184ec5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:703f1470-5b22-4bd9-b310-b8043c4ba269+11:14425:x1873884678836096:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1787076088.300495:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184ec5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:703f1470-5b22-4bd9-b310-b8043c4ba269+12:14425:x1873884678836096:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 390us (1038us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787076088.300505:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:0.0:1787076088.391830:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076088.392050:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678836224 00000100:00100000:2.0:1787076088.392065:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678836224 00000100:00100000:2.0:1787076088.392151:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:2.0:1787076088.392163:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+10:14431:x1873884678836224:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1787076088.392193:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787076088.392246:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a0a20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76238d2 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392335:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392352:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392365:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392382:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0a2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392390:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0a2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392396:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0a2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392533:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841a00/0x859911ad686a0a35 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392541:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841a00/0x859911ad686a0a35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392548:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841a00/0x859911ad686a0a35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787076088.392586:0:14323:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787076088.392590:0:14323:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787076088.392686:0:14323:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841a00/0x859911ad686a0a35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392708:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392715:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a27 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392722:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392729:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787076088.392733:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392741:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a27 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392756:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996194304e00) 00010000:00010000:2.0:1787076088.392759:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787076088.392764:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392770:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392785:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0a2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392791:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0a2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392797:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0a2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392808:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840e00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787076088.392811:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0a2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392817:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0a2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392825:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff996191b79900) 00010000:00010000:2.0:1787076088.392827:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787076088.392830:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0a2e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392836:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0a2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392877:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a0a20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238d2 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392892:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841a00/0x859911ad686a0a35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238d2 expref: 11 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.392899:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996187c34c00) 00010000:00010000:2.0:1787076088.392902:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787076088.392904:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1841a00, rc 0) 00000100:00100000:2.0:1787076088.393005:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+11:14431:x1873884678836224:12345-192.168.204.50@tcp:101:bash.0 Request processed in 843us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076088.393014:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:3.0:1787076088.401070:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076088.401249:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678836480 00000100:00100000:1.0:1787076088.401266:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678836480 00000100:00100000:1.0:1787076088.401354:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:1.0:1787076088.401368:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+11:14431:x1873884678836480:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1787076088.401401:0:15531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787076088.401450:0:15531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0a3c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76238d9 expref: -99 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.402005:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a0a43 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.402042:0:15531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0a19 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238cb expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.402054:0:15531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a0a43 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.402115:0:15531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0a19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238cb expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.402210:0:15531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0a19 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238cb expref: 11 pid: 14324 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076088.402229:0:15531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15531:1873884700841856:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787076088.402410:0:15531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961a03953c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787076088.406126:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076088.406362:0:15531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15531:1873884700841856:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787076088.406398:0:15531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a0a43 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076088.406467:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678836608 00000100:00100000:0.0:1787076088.406477:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678836608 00010000:00010000:0.0:1787076088.406529:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0a19 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238cb expref: 12 pid: 14324 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076088.406630:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:0.0:1787076088.406688:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1844e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:703f1470-5b22-4bd9-b310-b8043c4ba269+12:2362:x1873884678836608:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787076088.406709:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787076088.406718:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0a19 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238cb expref: 12 pid: 14324 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076088.406733:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0a19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238cb expref: 12 pid: 14324 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076088.406774:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0a19 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238cb expref: 12 pid: 14324 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076088.406797:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996187c34c00) 00010000:00010000:0.0:1787076088.406804:0:14309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a0a43 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076088.406838:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a0a43 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076088.406847:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a0a43 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076088.406885:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787076088.406959:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1844e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:703f1470-5b22-4bd9-b310-b8043c4ba269+11:2362:x1873884678836608:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 318us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076088.406968:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00010000:00010000:1.0:1787076088.407404:0:15531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a0a43 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.407415:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a0a43 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.407444:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0a4a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.407455:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0a4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.407464:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0a4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.410027:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0a51 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.410058:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0a51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.410072:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0a51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787076088.410087:0:15531:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787076088.410127:0:15531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a0a43 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.410134:0:15531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a0a43 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.410166:0:15531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a0a43 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.410173:0:15531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787076088.410178:0:15531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a0a43 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.410186:0:15531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a0a43 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.410201:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996187c34c00) 00010000:00010000:1.0:1787076088.410206:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787076088.410212:0:15531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a0a43 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.410334:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840800/0x859911ad686a0a43 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787076088.410355:0:15531:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 0000000036380a2e reply state 00000000a93cb411 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0a4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076088.410366:0:15531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787076088.410418:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0a3c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238d9 expref: 14 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.410435:0:15531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0a51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238d9 expref: 13 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.410443:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:1.0:1787076088.410453:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787076088.410457:0:15531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190038400, rc 0) 00000100:00100000:1.0:1787076088.410798:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+14:14431:x1873884678836480:12345-192.168.204.50@tcp:101:bash.0 Request processed in 9431us (9742us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787076088.410811:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 28 00010000:00010000:2.0:1787076088.416838:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0a4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.416866:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0a4a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.416876:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0a4a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.416885:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190039800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787076088.416909:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0a4a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.416924:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0a4a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.416946:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff996187c34a00) 00010000:00010000:2.0:1787076088.416950:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787076088.416956:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0a4a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.416964:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0a4a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076088.424400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076088.424693:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678836736 00000100:00100000:2.0:1787076088.424706:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678836736 00000100:00100000:2.0:1787076088.424784:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:2.0:1787076088.424796:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+13:14431:x1873884678836736:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1787076088.424835:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787076088.424860:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0a5f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76238e0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.424950:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a66 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.424965:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.424978:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787076088.425047:0:14323:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787076088.425052:0:14323:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787076088.425074:0:14323:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.425086:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.425113:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0a5f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238e0 expref: 15 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.425132:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238e0 expref: 14 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.425141:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:2.0:1787076088.425144:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787076088.425148:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1841c00, rc 0) 00000100:00100000:2.0:1787076088.425233:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+14:14431:x1873884678836736:12345-192.168.204.50@tcp:101:bash.0 Request processed in 439us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076088.425240:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:3.0:1787076088.432706:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076088.432807:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678836992 00000100:00100000:2.0:1787076088.432820:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678836992 00000100:00100000:2.0:1787076088.432894:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:2.0:1787076088.432906:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+14:14431:x1873884678836992:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:2.0:1787076088.433383:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+15:14431:x1873884678836992:12345-192.168.204.50@tcp:35:bash.0 Request processed in 477us (689us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787076088.433393:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:3.0:1787076088.550629:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076088.555258:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678837248 00000100:00100000:0.0:1787076088.555282:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678837248 00000100:00100000:0.0:1787076088.555395:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:0.0:1787076088.555409:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+15:14441:x1873884678837248:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787076088.555463:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787076088.555498:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99608125ce00/0x859911ad686a0a6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76238e7 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787076088.555733:0:14325:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787076088.555915:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99608125ce00/0x859911ad686a0a6d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238e7 expref: 17 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076088.555933:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff996194304e00) 00010000:00010000:0.0:1787076088.555936:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787076088.555941:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99608125ce00/0x859911ad686a0a6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238e7 expref: 17 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076088.555958:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99608125ce00, rc 0) 00000100:00100000:0.0:1787076088.556071:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+16:14441:x1873884678837248:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 665us (5467us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787076088.556079:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:3.0:1787076088.566562:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076088.566732:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678837504 00000100:00100000:2.0:1787076088.566746:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678837504 00000100:00100000:2.0:1787076088.566811:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:2.0:1787076088.566822:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+16:14441:x1873884678837504:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1787076088.567192:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+17:14441:x1873884678837504:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 369us (646us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787076088.567201:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:3.0:1787076088.613492:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076088.614409:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678837760 00000100:00100000:2.0:1787076088.614427:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678837760 00000100:00100000:2.0:1787076088.614746:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:2.0:1787076088.614770:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+17:14444:x1873884678837760:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787076088.614810:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787076088.614840:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0a7b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76238ee expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.614999:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a0a82 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.615018:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a0a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.615032:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a0a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787076088.615048:0:14323:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787076088.615487:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0a7b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238ee expref: 20 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.615513:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a0a82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238ee expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076088.615841:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:2.0:1787076088.615844:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787076088.615847:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1841e00, rc 0) 00000100:00100000:2.0:1787076088.615959:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+19:14444:x1873884678837760:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1192us (2482us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787076088.615969:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:3.0:1787076088.621416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076088.624746:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076088.624779:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678838016 00000100:00100000:3.0:1787076088.624792:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678838016 00000100:00100000:3.0:1787076088.624885:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:3.0:1787076088.624898:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+19:2361:x1873884678838016:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787076088.624920:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787076088.624955:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a0a82 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238ee expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076088.624979:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:3.0:1787076088.624985:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787076088.625066:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+18:2361:x1873884678838016:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 171us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076088.625075:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:1.0:1787076088.625558:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678837888 00000100:00100000:1.0:1787076088.625567:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678837888 00000100:00100000:1.0:1787076088.625631:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:1.0:1787076088.625661:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+18:14444:x1873884678837888:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:1.0:1787076088.625746:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0a90 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.625778:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0a90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.625792:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0a90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.625830:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0a90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.625838:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0a90 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.625845:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0a90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.625852:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787076088.625857:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0a90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.625887:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0a90 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.625898:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:1.0:1787076088.625902:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787076088.625907:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0a90 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076088.625914:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0a90 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076088.625990:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+18:14444:x1873884678837888:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 350us (4590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076088.625998:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:3.0:1787076088.642948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076088.643128:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678838272 00000100:00100000:2.0:1787076088.643142:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678838272 00000100:00100000:2.0:1787076088.643297:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:2.0:1787076088.643315:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+18:14444:x1873884678838272:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1787076088.644427:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+19:14444:x1873884678838272:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 1109us (1486us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787076088.644440:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000040:00080000:1.0:1787076088.648358:0:14356:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787076089.030558:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076089.030736:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678838528 00000100:00100000:0.0:1787076089.030752:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678838528 00000100:00100000:0.0:1787076089.030848:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:0.0:1787076089.030872:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+19:14475:x1873884678838528:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1787076089.030906:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787076089.030933:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99608125ce00/0x859911ad686a0a97 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76238f5 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076089.031081:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99608125d800/0x859911ad686a0a9e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076089.031102:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99608125d800/0x859911ad686a0a9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076089.031119:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99608125d800/0x859911ad686a0a9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787076089.031134:0:14324:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00080000:1.0:1787076089.035733:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787076089.043867:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99608125ce00/0x859911ad686a0a97 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238f5 expref: 22 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076089.043923:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99608125d800/0x859911ad686a0a9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238f5 expref: 21 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076089.043934:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:0.0:1787076089.043937:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787076089.043969:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99608125d800, rc 0) 00000100:00100000:0.0:1787076089.044106:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+21:14475:x1873884678838528:12345-192.168.204.50@tcp:101:cat.0 Request processed in 13235us (13563us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787076089.044117:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:3.0:1787076089.048906:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076089.048951:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076089.049200:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678838656 00000100:00100000:0.0:1787076089.049221:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678838656 00000100:00100000:0.0:1787076089.049340:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:1.0:1787076089.049344:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678838912 00000100:00100000:0.0:1787076089.049358:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+21:2359:x1873884678838656:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787076089.049360:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678838912 00010000:00010000:0.0:1787076089.049385:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787076089.049422:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99608125d800/0x859911ad686a0a9e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238f5 expref: 22 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076089.049435:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:1.0:1787076089.049447:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+21:14475:x1873884678838912:12345-192.168.204.50@tcp:35:cat.0 00010000:00010000:0.0:1787076089.049460:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:0.0:1787076089.049468:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787076089.049556:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+21:2359:x1873884678838656:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 201us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076089.049565:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:1.0:1787076089.049914:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+21:14475:x1873884678838912:12345-192.168.204.50@tcp:35:cat.0 Request processed in 467us (959us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787076089.049923:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:3.0:1787076089.132856:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076089.134474:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678839168 00000100:00100000:2.0:1787076089.134506:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678839168 00000100:00100000:2.0:1787076089.134625:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:2.0:1787076089.134673:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+21:14481:x1873884678839168:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:2.0:1787076089.134715:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787076089.134750:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0aac lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e76238fc expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.134911:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0ab3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.134931:0:14323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0a51 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238d9 expref: 22 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.134961:0:14323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a66 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238e0 expref: 22 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.134970:0:14323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0ab3 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.135022:0:14323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238e0 expref: 22 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.135040:0:14323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a66 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238e0 expref: 22 pid: 14323 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076089.135073:0:14323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14323:1873884700841984:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787076089.135802:0:14323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0a51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238d9 expref: 22 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.135818:0:14323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0a51 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238d9 expref: 22 pid: 15531 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076089.135831:0:14323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14323:1873884700842112:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787076089.135874:0:14323:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961a03953c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787076089.143046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076089.143225:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678839296 00000100:00100000:3.0:1787076089.143238:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678839296 00010000:00010000:3.0:1787076089.143303:0:14310:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a66 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238e0 expref: 23 pid: 14323 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076089.143354:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:3.0:1787076089.143367:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bba08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+23:2362:x1873884678839296:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787076089.143388:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787076089.143398:0:14310:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a66 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238e0 expref: 23 pid: 14323 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.143414:0:14310:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a66 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238e0 expref: 23 pid: 14323 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.143444:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:3.0:1787076089.143450:0:14310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0ab3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.143460:0:14310:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0ab3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.143468:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787076089.143558:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bba08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+23:2362:x1873884678839296:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 193us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076089.143568:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:0.0:1787076089.144040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076089.144472:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678839424 00000100:00100000:3.0:1787076089.144481:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678839424 00010000:00010000:3.0:1787076089.144517:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0a51 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238d9 expref: 23 pid: 15531 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076089.144558:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:3.0:1787076089.144568:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+23:2362:x1873884678839424:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787076089.144582:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787076089.144588:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0a51 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238d9 expref: 23 pid: 15531 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.144613:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0a51 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238d9 expref: 23 pid: 15531 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.144633:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:3.0:1787076089.144670:0:14311:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0ab3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.144682:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0ab3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.144690:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0ab3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.144716:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787076089.144883:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+23:2362:x1873884678839424:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 316us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076089.144906:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00010000:00010000:2.0:1787076089.145022:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841c00/0x859911ad686a0a66 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238e0 expref: 22 pid: 14323 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076089.145044:0:14323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b00fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14323:1873884700841984:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787076089.145081:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0a51 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238d9 expref: 21 pid: 15531 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076089.145095:0:14323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14323:1873884700842112:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787076089.145125:0:14323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0ab3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.145135:0:14323:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0ab3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.145141:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0ab3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787076089.145165:0:14323:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787076089.145441:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0aac lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238fc expref: 22 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.145457:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840c00/0x859911ad686a0ab3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e76238fc expref: 21 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.145465:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:2.0:1787076089.145468:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787076089.145470:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1840c00, rc 0) 00000100:00100000:2.0:1787076089.145507:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+21:14481:x1873884678839168:12345-192.168.204.50@tcp:101:dd.0 Request processed in 10873us (12670us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787076089.145514:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:3.0:1787076089.154123:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076089.154589:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678839680 00000100:00100000:1.0:1787076089.154614:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678839680 00000100:00100000:1.0:1787076089.154816:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:1.0:1787076089.154828:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+21:14481:x1873884678839680:12345-192.168.204.50@tcp:36:dd.0 00010000:00010000:1.0:1787076089.155519:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0ac1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.155547:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.155562:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787076089.158450:0:15531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787076089.158584:0:15531:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 000000005f063a44 reply state 00000000b12471f7 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076089.158612:0:15531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787076089.160912:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+24:14481:x1873884678839680:12345-192.168.204.50@tcp:36:dd.0 Request processed in 6069us (6790us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787076089.160929:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00000020:00080000:1.0:1787076089.160940:0:15531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787076089.169083:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.169133:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0ac1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.169141:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0ac1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.169149:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190039800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:2.0:1787076089.169155:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0ac1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.169164:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0ac1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.169188:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:2.0:1787076089.169191:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787076089.169198:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0ac1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.169204:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0ac1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076089.176154:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076089.176708:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678839808 00000100:00100000:0.0:1787076089.176734:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678839808 00000100:00100000:0.0:1787076089.176827:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:0.0:1787076089.176840:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+23:14481:x1873884678839808:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:0.0:1787076089.176877:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787076089.176906:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99608125c200/0x859911ad686a0ac8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623903 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076089.177030:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99608125c200/0x859911ad686a0ac8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623903 expref: 24 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076089.177049:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99608125c200/0x859911ad686a0ac8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623903 expref: 24 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076089.177072:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:0.0:1787076089.177075:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787076089.177081:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99608125c200, rc 0) 00000100:00100000:0.0:1787076089.177177:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+24:14481:x1873884678839808:12345-192.168.204.50@tcp:101:dd.0 Request processed in 339us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076089.177186:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:1.0:1787076089.205536:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076089.205851:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678840064 00000100:00100000:0.0:1787076089.205867:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678840064 00000100:00100000:3.0:1787076089.206076:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:3.0:1787076089.206094:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+24:14481:x1873884678840064:12345-192.168.204.50@tcp:103:dd.0 00010000:00010000:3.0:1787076089.206118:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787076089.206169:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99608125c200/0x859911ad686a0ac8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623903 expref: 24 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.206212:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:3.0:1787076089.206218:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787076089.206304:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+23:14481:x1873884678840064:12345-192.168.204.50@tcp:103:dd.0 Request processed in 216us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076089.206313:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:3.0:1787076089.215110:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076089.215868:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678840192 00000100:00100000:0.0:1787076089.216030:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678840192 00000100:00100000:1.0:1787076089.217591:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:1.0:1787076089.217628:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+23:14481:x1873884678840192:12345-192.168.204.50@tcp:58:dd.0 00010000:00010000:1.0:1787076089.217977:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a0acf lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.218229:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a0acf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.218246:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a0acf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787076089.220528:0:14324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787076089.220881:0:14324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787076089.220988:0:14324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787076089.221580:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+23:14481:x1873884678840192:12345-192.168.204.50@tcp:58:dd.0 Request processed in 3945us (6475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076089.221608:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:1.0:1787076089.232942:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076089.234171:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678840320 00000100:00100000:2.0:1787076089.234206:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678840320 00000100:00100000:2.0:1787076089.234306:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:2.0:1787076089.234320:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+23:14481:x1873884678840320:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:2.0:1787076089.234535:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787076089.234571:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0ad6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762390a expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.234720:0:14323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a0acf lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.234752:0:14323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0ad6 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762390a expref: 24 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.234782:0:14323:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a0acf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.234799:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0ad6 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762390a expref: 24 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.234817:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:2.0:1787076089.234821:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787076089.234826:0:14323:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0ad6 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762390a expref: 24 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.234833:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1840e00, rc 0) 00000100:00100000:2.0:1787076089.234937:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+24:14481:x1873884678840320:12345-192.168.204.50@tcp:101:dd.0 Request processed in 620us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076089.234946:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00010000:00010000:0.0:1787076089.294981:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787076089.544319:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787076089.544355:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700842240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787076089.544459:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787076089.544630:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700842240 00000100:00100000:0.0:1787076089.544672:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700842240 00000100:00100000:0.0:1787076089.544757:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1787076089.544764:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787076089.544771:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700842240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787076089.544833:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787076089.544899:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700842240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076089.544908:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787076089.547294:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700842240:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787076089.664113:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934606 is committed 00000001:00080000:2.0:1787076089.664132:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:2.0:1787076089.664142:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:2.0:1787076089.664153:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:2.0:1787076089.664171:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:1.0:1787076089.672059:0:14356:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787076089.672070:0:14356:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787076089.672128:0:14356:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787076089.672136:0:14356:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787076089.672260:0:14356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b52cbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14356:1873884700842368:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787076089.672421:0:14356:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eebcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787076089.685984:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076089.686217:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678840448 00000100:00100000:0.0:1787076089.686227:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678840448 00000100:00100000:0.0:1787076089.686303:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:0.0:1787076089.686311:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:68657535-b9e1-4ead-a295-31f2243e0fc4+12:14482:x1873884678840448:12345-192.168.204.50@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787076089.686380:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:68657535-b9e1-4ead-a295-31f2243e0fc4+12:14482:x1873884678840448:12345-192.168.204.50@tcp:900:lhsmtool_posix.0 Request processed in 70us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076089.686388:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:2.0:1787076089.687280:0:14356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b52cbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14356:1873884700842368:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787076089.691816:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076089.691903:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678840576 00000100:00100000:3.0:1787076089.691914:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678840576 00000100:00100000:3.0:1787076089.691979:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:3.0:1787076089.691990:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+11:14482:x1873884678840576:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787076089.692043:0:15531:0:(mdt_handler.c:8026:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787076089.692168:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+11:14482:x1873884678840576:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 178us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076089.692190:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:3.0:1787076089.703541:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076089.703872:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678840704 00000100:00100000:1.0:1787076089.703881:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678840704 00000100:00100000:1.0:1787076089.703945:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:1.0:1787076089.703956:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+11:14482:x1873884678840704:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787076089.704041:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0add lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704058:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0add lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704069:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0add lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704085:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0ae4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704105:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704112:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704135:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0aeb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704144:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0aeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704150:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0aeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787076089.704186:0:14325:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787076089.704191:0:14325:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787076089.704205:0:14325:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0aeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704216:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0add lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704222:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0add lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704228:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0add lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704234:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190039800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787076089.704238:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0add lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704252:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0add lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704265:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996194304a00) 00010000:00010000:1.0:1787076089.704267:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787076089.704272:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0add lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704278:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0add lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704293:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704299:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704305:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704309:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787076089.704311:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704316:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704322:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff996187c34600) 00010000:00010000:1.0:1787076089.704324:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787076089.704327:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0ae4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704341:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0ae4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704355:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0aeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704360:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0aeb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704365:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0aeb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704371:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787076089.704373:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0aeb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704379:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0aeb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704386:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:1.0:1787076089.704388:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787076089.704390:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0aeb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.704395:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0aeb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076089.704469:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+11:14482:x1873884678840704:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 Request processed in 514us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076089.704478:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:2.0:1787076089.708338:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076089.708440:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678840960 00000100:00100000:3.0:1787076089.708450:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678840960 00000100:00100000:3.0:1787076089.708514:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:3.0:1787076089.708525:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+11:14482:x1873884678840960:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787076089.708550:0:15531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787076089.708570:0:15531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad686a0af2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623911 expref: -99 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.708721:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0af9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.708747:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0af9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.708762:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0af9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787076089.708774:0:15531:0:(mdt_handler.c:919:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787076089.708912:0:15531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0af9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.708921:0:15531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0af9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.708927:0:15531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0af9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.708933:0:15531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996181522200 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787076089.708952:0:15531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0af9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.708960:0:15531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0af9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.708975:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:3.0:1787076089.708978:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787076089.708983:0:15531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0af9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.708988:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0af9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.709237:0:15531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad686a0af2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623911 expref: 13 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.709248:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff996194304a00) 00010000:00010000:3.0:1787076089.709250:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787076089.709254:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad686a0af2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623911 expref: 13 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.709264:0:15531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522800, rc 0) 00000100:00100000:3.0:1787076089.709434:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+12:14482:x1873884678840960:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 911us (1108us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1787076089.709443:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:0.0:1787076089.724152:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076089.726881:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678841088 00000100:00100000:1.0:1787076089.726899:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678841088 00000100:00100000:1.0:1787076089.726983:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:1.0:1787076089.726994:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+12:14482:x1873884678841088:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787076089.727051:0:14325:0:(mdt_handler.c:8026:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787076089.727175:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+12:14482:x1873884678841088:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 182us (3033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076089.727183:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:1.0:1787076089.766937:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076089.767253:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678841344 00000100:00100000:2.0:1787076089.767281:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678841344 00000100:00100000:2.0:1787076089.767347:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:2.0:1787076089.767359:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+12:14482:x1873884678841344:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787076089.767382:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787076089.767405:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a0b07 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623918 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787076089.768560:0:14324:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1787076089.768572:0:14324:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1787076089.768630:0:14324:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1787076089.769304:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0b0e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.769320:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0b0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.769331:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0b0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.769399:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841400/0x859911ad686a0b07 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623918 expref: 15 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.769419:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0b0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623918 expref: 14 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.769427:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996191b79300) 00010000:00010000:2.0:1787076089.769430:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787076089.769433:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9961c1840600, rc 0) 00000100:00100000:2.0:1787076089.769574:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+14:14482:x1873884678841344:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 2217us (2648us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787076089.769601:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:3.0:1787076089.780132:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076089.780243:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678841600 00000100:00100000:1.0:1787076089.780252:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678841600 00000100:00100000:1.0:1787076089.780324:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:1.0:1787076089.780334:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+14:14482:x1873884678841600:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787076089.780405:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787076089.780436:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0b0e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623918 expref: 14 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.780456:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996191b79300) 00010000:00010000:1.0:1787076089.780469:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787076089.780496:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b1c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.780511:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b1c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.780521:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b1c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.780601:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b23 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xafed379c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.780627:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xafed379c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.780634:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xafed379c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.781011:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b1c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.781020:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b1c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.781026:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b1c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.781032:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038400 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787076089.781036:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b1c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.781043:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b1c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.781052:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff996187c34c00) 00010000:00010000:1.0:1787076089.781055:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787076089.781059:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b1c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.781064:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b1c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.781073:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xafed379c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.781085:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b23 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xafed379c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.781089:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xafed379c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.781094:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190039800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787076089.781097:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xafed379c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.781102:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b23 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xafed379c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.781110:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xafed379c (ffff996187c34600) 00010000:00010000:1.0:1787076089.781112:0:14325:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787076089.781115:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b23 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xafed379c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.781120:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b23 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xafed379c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076089.781204:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+13:14482:x1873884678841600:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 870us (1082us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787076089.781212:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:0.0:1787076089.787488:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076089.788202:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678841728 00000100:00100000:3.0:1787076089.788220:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678841728 00000100:00100000:3.0:1787076089.788376:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:3.0:1787076089.788414:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+13:14482:x1873884678841728:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787076089.788446:0:15531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787076089.788479:0:15531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad686a0b2a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762391f expref: -99 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.788532:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0b31 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.788550:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0b31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.788564:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0b31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.789054:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996181522800/0x859911ad686a0b2a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762391f expref: 15 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.789081:0:15531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996181522200/0x859911ad686a0b31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762391f expref: 14 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.789092:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996194304500) 00010000:00010000:3.0:1787076089.789095:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787076089.789099:0:15531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522200, rc 0) 00000100:00100000:3.0:1787076089.789193:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+14:14482:x1873884678841728:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 785us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076089.789202:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:0.0:1787076089.794947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076089.795111:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678841984 00000100:00100000:1.0:1787076089.795122:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678841984 00000100:00100000:1.0:1787076089.795188:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:1.0:1787076089.795200:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+14:14482:x1873884678841984:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787076089.795292:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b38 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.795327:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.795340:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787076089.797323:0:14325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1787076089.797341:0:14325:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 471772700145ns, next at 472772697065ns, rc = 0 00000004:00010000:1.0:1787076089.797451:0:14325:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 00000000d702acb6 reply state 000000008bbd29a2 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076089.797463:0:14325:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787076089.797609:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+16:14482:x1873884678841984:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 2408us (2670us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787076089.797618:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:2.0:1787076089.801774:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076089.801931:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678842112 00000100:00100000:1.0:1787076089.801942:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678842112 00000100:00100000:1.0:1787076089.802022:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:1.0:1787076089.802032:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+16:14482:x1873884678842112:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787076089.802057:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787076089.802078:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b3f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623926 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.802141:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623926 expref: 17 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.802156:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623926 expref: 17 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.802196:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996194304500) 00010000:00010000:1.0:1787076089.802199:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787076089.802203:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190038400, rc 0) 00000100:00100000:1.0:1787076089.802252:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+17:14482:x1873884678842112:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 222us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076089.802260:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 47 00010000:00010000:3.0:1787076089.803553:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.803595:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b38 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.803603:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.803610:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190039800 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:3.0:1787076089.803614:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.803622:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b38 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.803676:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996194304500) 00010000:00010000:3.0:1787076089.803680:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787076089.803685:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b38 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.803691:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b38 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076089.810104:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076089.810213:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678842240 00000100:00100000:1.0:1787076089.810223:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678842240 00000100:00100000:1.0:1787076089.810305:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:1.0:1787076089.810318:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+5:2361:x1873884678842240:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787076089.810745:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787076089.810982:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+6:2361:x1873884678842240:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 665us (886us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787076089.810991:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:0.0:1787076089.824962:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076089.825073:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678842496 00000100:00100000:2.0:1787076089.825085:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678842496 00000100:00100000:2.0:1787076089.825151:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:2.0:1787076089.825161:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+16:14482:x1873884678842496:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787076089.825412:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+17:14482:x1873884678842496:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 252us (461us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787076089.825421:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:2.0:1787076089.833072:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076089.836690:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678842752 00000100:00100000:1.0:1787076089.836708:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678842752 00000100:00100000:1.0:1787076089.836921:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:1.0:1787076089.836934:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+17:14482:x1873884678842752:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787076089.837260:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+17:14482:x1873884678842752:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 327us (4199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076089.837269:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:0.0:1787076089.845513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076089.845614:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678842880 00000100:00100000:1.0:1787076089.845625:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678842880 00000100:00100000:1.0:1787076089.845727:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:1.0:1787076089.845747:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+17:14482:x1873884678842880:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787076089.845788:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787076089.845809:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b46 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762392d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.845904:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b4d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.845919:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.845931:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787076089.845968:0:14324:0:(mdt_handler.c:1584:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787076089.845987:0:14324:0:(mdt_handler.c:2555:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.846012:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b46 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762392d expref: 19 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.846028:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762392d expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.846036:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996194304500) 00010000:00010000:1.0:1787076089.846039:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787076089.846043:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996190039800, rc 0) 00000100:00100000:1.0:1787076089.846625:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+18:14482:x1873884678842880:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 885us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076089.846634:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:0.0:1787076089.862020:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076089.863134:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678843008 00000100:00100000:3.0:1787076089.863147:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678843008 00000100:00100000:3.0:1787076089.863220:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:3.0:1787076089.863231:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+6:2360:x1873884678843008:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787076089.863249:0:15009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787076089.863282:0:15009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad686a0b54 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e7623934 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787076089.863326:0:15009:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a849dfa, blocks: 0x1 00010000:00010000:3.0:1787076089.863348:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787076089.863354:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787076089.863363:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad686a0b54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623934 expref: 7 pid: 15009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.863384:0:15009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad686a0b54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623934 expref: 7 pid: 15009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.863397:0:15009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181522800, rc 0) 00000100:00100000:3.0:1787076089.863468:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+7:2360:x1873884678843008:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 238us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076089.863476:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:2.0:1787076089.883705:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076089.884306:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678843264 00000100:00100000:3.0:1787076089.884326:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678843264 00000100:00100000:3.0:1787076089.884413:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:3.0:1787076089.884424:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+18:14482:x1873884678843264:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787076089.884580:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+18:14482:x1873884678843264:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 157us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076089.884599:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:1.0:1787076089.887028:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076089.887361:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678843392 00000100:00100000:2.0:1787076089.887374:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678843392 00000100:00100000:2.0:1787076089.887443:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:2.0:1787076089.888390:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+18:14482:x1873884678843392:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787076089.945018:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+18:14482:x1873884678843392:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 Request processed in 57548us (57997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076089.945038:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 51 00000001:00080000:3.0:1787076089.945362:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:3.0:1787076089.945372:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1787076089.945405:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:2.0:1787076089.946014:0:3314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961a6e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700842496:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787076089.946107:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076089.946156:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700842496 00000100:00100000:1.0:1787076089.946168:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700842496 00000100:00100000:1.0:1787076089.946240:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787076089.946251:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961a6e44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1873884700842496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787076089.946487:0:15008:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787076089.946491:0:15008:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787076089.946493:0:15008:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787076089.946495:0:15008:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787076090 -> 1787076090 00002000:00010000:1.0:1787076089.946498:0:15008:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787076089.946557:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961a6e44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1873884700842496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 308us (451us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787076089.946566:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787076089.946606:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787076089.946696:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9961a6e45180/2, rc 0, transno 8589934595 00000100:00100000:2.0:1787076089.946705:0:3314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961a6e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1873884700842496:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787076089.952627:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076089.952930:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678843520 00000100:00100000:0.0:1787076089.953016:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678843520 00000100:00100000:0.0:1787076089.953141:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:0.0:1787076089.953154:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b52cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+7:2361:x1873884678843520:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787076089.953347:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b52cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+7:2361:x1873884678843520:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 Request processed in 195us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076089.953355:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:0.0:1787076089.956252:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076089.956344:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678843776 00000100:00100000:3.0:1787076089.956376:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678843776 00000100:00100000:3.0:1787076089.956453:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:3.0:1787076089.956465:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+14:14482:x1873884678843776:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787076089.956695:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787076089.956851:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190039800/0x859911ad686a0b4d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762392d expref: 14 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.956882:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996194304500) 00010000:00010000:3.0:1787076089.956889:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787076089.957126:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0b5b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.957145:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0b5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076089.957159:0:14325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0b5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787076089.957413:0:14325:0:(mdt_handler.c:4542:mdt_save_lock()) ### save lock request 0000000054f5fd90 reply state 0000000009d577da transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0b5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076089.957424:0:14325:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787076089.957666:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+15:14482:x1873884678843776:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 1175us (1400us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787076089.957677:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:1.0:1787076089.967487:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1787076089.968423:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0b5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076089.968442:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0b5b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076089.968551:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0b5b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076089.968559:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840600 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:0.0:1787076089.968565:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0b5b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076089.968574:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0b5b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076089.968687:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996194304500) 00010000:00010000:0.0:1787076089.968692:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787076089.968698:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0b5b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076089.968706:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840600/0x859911ad686a0b5b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14325 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076089.969394:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678843904 00000100:00100000:3.0:1787076089.969411:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678843904 00000100:00100000:3.0:1787076089.969615:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:3.0:1787076089.969629:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b516f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+7:14482:x1873884678843904:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787076089.969694:0:15009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787076089.969718:0:15009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a0b62 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc9e60e74e762393b expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.969773:0:15009:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad686a0b54 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623934 expref: 8 pid: 15009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.969784:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787076089.969789:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787076089.969795:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a0b62 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762393b expref: 8 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.969844:0:15009:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad686a0b54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623934 expref: 8 pid: 15009 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076089.969882:0:15009:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad686a0b54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623934 expref: 8 pid: 15009 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076089.969901:0:15009:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1882a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15009:1873884700842624:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787076089.970053:0:15009:0:(client.c:2702:ptlrpc_set_wait()) set ffff996182d693c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787076089.980571:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076089.981534:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678844032 00000100:00100000:0.0:1787076089.981551:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678844032 00010000:00010000:0.0:1787076089.981634:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad686a0b54 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623934 expref: 9 pid: 15009 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076089.981717:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:0.0:1787076089.981745:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf77a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+9:2362:x1873884678844032:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787076089.981766:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787076089.981801:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad686a0b54 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623934 expref: 9 pid: 15009 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076089.981849:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad686a0b54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623934 expref: 9 pid: 15009 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076089.981890:0:14311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076089.981895:0:14311:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076089.981904:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a0b62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762393b expref: 9 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076089.981916:0:14311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a0b62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762393b expref: 9 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076089.981971:0:14311:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a0b62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762393b expref: 9 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076089.982208:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b9df9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14311:1873884700842752:192.168.204.50@tcp:105: 00000100:00100000:0.0:1787076089.982405:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffff996183ec3540 going to sleep for 11 seconds 00010000:00010000:1.0:1787076089.982747:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000221950b0/0x859911ad686a0b54 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623934 expref: 9 pid: 15009 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076089.982776:0:15009:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1882a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15009:1873884700842624:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787076089.982812:0:15009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a0b62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762393b expref: 8 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.982825:0:15009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff996181523800, rc 0) 00000100:00100000:1.0:1787076089.982866:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b516f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+8:14482:x1873884678843904:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 13239us (15404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076089.982877:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:0.0:1787076089.987865:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076089.988130:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b9df9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14311:1873884700842752:192.168.204.50@tcp:105: 00010000:00010000:3.0:1787076089.988163:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787076089.988252:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf77a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+7:2362:x1873884678844032:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6524us (7705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787076089.988265:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:1.0:1787076089.988431:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678844160 00000100:00100000:1.0:1787076089.988443:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678844160 00000100:00100000:1.0:1787076089.988511:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:1.0:1787076089.988526:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+7:2362:x1873884678844160:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787076089.989627:0:15006:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787076089.989636:0:15006:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787076089 00002000:00010000:1.0:1787076089.989680:0:15006:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787076088 00002000:00010000:1.0:1787076089.989683:0:15006:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787076090 -> 1787076089 00002000:00010000:1.0:1787076089.989685:0:15006:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787076089.990237:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+8:2362:x1873884678844160:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 1706us (2380us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787076089.990251:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:2.0:1787076089.993175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076089.994595:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678844288 00000100:00100000:1.0:1787076089.994613:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678844288 00000100:00100000:1.0:1787076089.995861:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:1.0:1787076089.995888:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+8:2361:x1873884678844288:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787076089.995971:0:15009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000f119f7e/0x859911ad686a0b69 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.995999:0:15009:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a0b62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762393b expref: 8 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.996010:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076089.996015:0:15009:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787076089.996020:0:15009:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f119f7e/0x859911ad686a0b69 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.996097:0:15009:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a0b62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762393b expref: 8 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076089.996116:0:15009:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a0b62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762393b expref: 8 pid: 15009 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076089.996136:0:15009:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15009:1873884700842880:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787076089.996274:0:15009:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eeb600 going to sleep for 11 seconds 00000100:00100000:0.0:1787076090.013105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076090.013346:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678844416 00000100:00100000:2.0:1787076090.013360:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678844416 00010000:00010000:2.0:1787076090.013420:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a0b62 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762393b expref: 9 pid: 15009 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076090.013477:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:2.0:1787076090.013489:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+9:2362:x1873884678844416:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787076090.013510:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787076090.013543:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a0b62 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762393b expref: 9 pid: 15009 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.013596:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a0b62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762393b expref: 9 pid: 15009 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.013629:0:14309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787076090.013635:0:14309:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787076090.013673:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f119f7e/0x859911ad686a0b69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.013686:0:14309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f119f7e/0x859911ad686a0b69 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.013716:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787076090.013895:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+9:2362:x1873884678844416:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 408us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076090.013904:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00010000:00010000:1.0:1787076090.014123:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019752f80/0x859911ad686a0b62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762393b expref: 8 pid: 15009 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076090.014143:0:15009:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15009:1873884700842880:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787076090.014178:0:15009:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000f119f7e/0x859911ad686a0b69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.014201:0:15009:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000f119f7e/0x859911ad686a0b69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.014209:0:15009:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f119f7e/0x859911ad686a0b69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.014238:0:15009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000f119f7e/0x859911ad686a0b69 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.014260:0:15009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f119f7e/0x859911ad686a0b69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.014267:0:15009:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f119f7e/0x859911ad686a0b69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.014274:0:15009:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190039800 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787076090.014278:0:15009:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f119f7e/0x859911ad686a0b69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.014285:0:15009:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f119f7e/0x859911ad686a0b69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.014295:0:15009:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f119f7e/0x859911ad686a0b69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.014302:0:15009:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f119f7e/0x859911ad686a0b69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076090.014357:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+7:2361:x1873884678844288:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 Request processed in 18483us (21198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076090.014365:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:0.0:1787076090.017887:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076090.018057:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678844672 00000100:00100000:1.0:1787076090.018070:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678844672 00000100:00100000:1.0:1787076090.018146:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:1.0:1787076090.018172:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+14:14482:x1873884678844672:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787076090.018301:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0b70 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.018323:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0b70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.018338:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0b70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.018709:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b77 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.018721:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b3f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623926 expref: 15 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.019168:0:14324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b77 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.019275:0:14324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623926 expref: 15 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.019293:0:14324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b3f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623926 expref: 15 pid: 14324 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076090.019312:0:14324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14324:1873884700843008:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787076090.019430:0:14324:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eeb600 going to sleep for 11 seconds 00000100:00100000:0.0:1787076090.025234:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787076090.025409:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678844800 00000100:00100000:3.0:1787076090.025422:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678844800 00010000:00010000:3.0:1787076090.025487:0:14311:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b3f lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623926 expref: 16 pid: 14324 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787076090.025540:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:3.0:1787076090.025552:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+16:2362:x1873884678844800:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787076090.025572:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787076090.025591:0:14311:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b3f lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623926 expref: 16 pid: 14324 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076090.025608:0:14311:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b3f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623926 expref: 16 pid: 14324 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076090.025717:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996194304500) 00010000:00010000:3.0:1787076090.025724:0:14311:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b77 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076090.025875:0:14311:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b77 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076090.025886:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b77 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787076090.025913:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787076090.026357:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038400/0x859911ad686a0b3f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0xc9e60e74e7623926 expref: 16 pid: 14324 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076090.026395:0:14324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14324:1873884700843008:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787076090.026448:0:14324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b77 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.026459:0:14324:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b77 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.026466:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b77 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787076090.026791:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1787076090.026996:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1787076090.027047:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1787076090.027173:0:14324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b516f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14324:1873884700843136:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787076090.028708:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+18:2362:x1873884678844800:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3141us (3473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076090.028729:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:1.0:1787076090.030377:0:14324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076090.030439:0:14324:0:(client.c:2702:ptlrpc_set_wait()) set ffff996184eeb600 going to sleep for 11 seconds 00000100:00100000:2.0:1787076090.030672:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700843136 00000100:00100000:2.0:1787076090.030688:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700843136 00000100:00100000:2.0:1787076090.030771:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787076090.030784:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14324:x1873884700843136:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787076090.030957:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14324:x1873884700843136:12345-0@lo:1000:mdt00_001.0 Request processed in 174us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076090.030966:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787076090.032598:0:14324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b516f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14324:1873884700843136:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787076090.033540:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1787076090.033676:0:14324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bec0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14324:1873884700843264:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787076090.033758:0:14324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076090.033798:0:14324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9b1b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787076090.034879:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700843264 00000100:00100000:2.0:1787076090.034891:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700843264 00000100:00100000:2.0:1787076090.034966:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787076090.034977:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14324:x1873884700843264:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787076090.035547:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14324:x1873884700843264:12345-0@lo:1000:mdt00_001.0 Request processed in 568us (1783us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787076090.035557:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787076090.036420:0:14324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bec0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14324:1873884700843264:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787076090.036468:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b77 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.036479:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b77 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.036503:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b77 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.036511:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787076090.036515:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b77 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.036524:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b77 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.036540:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996194304500) 00010000:00010000:1.0:1787076090.036543:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787076090.036548:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b77 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.036554:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b77 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.036594:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a0acf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.036602:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a0acf lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.036608:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a0acf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.036614:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038a00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787076090.036617:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a0acf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.036632:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a0acf lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.036662:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:1.0:1787076090.036665:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787076090.036673:0:14324:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0ad6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762390a expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.036685:0:14324:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0ad6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762390a expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.036695:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762390a expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.037571:0:14324:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1840e00/0x859911ad686a0ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0xc9e60e74e762390a expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076090.037600:0:14324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961bec09180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14324:1873884700843392:192.168.204.50@tcp:105: 00000100:00100000:1.0:1787076090.038243:0:14324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9961b9b1b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787076090.053849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787076090.054101:0:14324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961bec09180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14324:1873884700843392:192.168.204.50@tcp:105: 00010000:00010000:1.0:1787076090.054271:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a0acf lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.054283:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038a00/0x859911ad686a0acf lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.054315:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b7e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076090.054447:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678844928 00000100:00100000:2.0:1787076090.054456:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678844928 00000100:00100000:2.0:1787076090.054527:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:2.0:1787076090.054537:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184ec4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+19:14481:x1873884678844928:12345-192.168.204.50@tcp:49:dd.0 00000100:00100000:2.0:1787076090.054754:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184ec4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+19:14481:x1873884678844928:12345-192.168.204.50@tcp:49:dd.0 Request processed in 217us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076090.054763:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00010000:00010000:1.0:1787076090.056275:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b7e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.056300:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b7e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.056314:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b7e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.056326:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b7e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.056334:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b7e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.056340:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038c00 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787076090.056991:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b7e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.057005:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b7e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.057019:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:1.0:1787076090.057023:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787076090.057027:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b7e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.057034:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038c00/0x859911ad686a0b7e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.057053:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0b70 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.057079:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0b70 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.057084:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0b70 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.057089:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038000 already unused, calling callback (ffffffffc1fcf4f0) 00010000:00010000:1.0:1787076090.057092:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0b70 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.057097:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0b70 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.057108:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff996187c34200) 00010000:00010000:1.0:1787076090.057109:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787076090.057112:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0b70 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.057117:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff996190038000/0x859911ad686a0b70 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076090.057872:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+18:14482:x1873884678844672:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 39698us (39997us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1787076090.057885:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 53 00000020:00080000:1.0:1787076090.057891:0:14324:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787076090.061837:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000040:00080000:2.0:1787076090.062004:0:14356:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787076090.062010:0:14356:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787076090.062160:0:14356:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787076090.062171:0:14356:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787076090.063194:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678845184 00000100:00100000:3.0:1787076090.063207:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678845184 00000100:00100000:2.0:1787076090.066974:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:2.0:1787076090.066991:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+18:14482:x1873884678845184:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787076090.071083:0:14326:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787076090.071426:0:14326:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787076090.071502:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a0b85 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.071520:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a0b85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.071544:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a0b85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.071779:0:14326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a0b85 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.071788:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a0b85 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.071795:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a0b85 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.071822:0:14326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787076090.071861:0:16041:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787076090.071870:0:16041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a0b85 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.071880:0:16041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841e00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787076090.071892:0:16041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a0b85 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.071911:0:16041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a0b85 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.071925:0:16041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff996194304500) 00010000:00010000:1.0:1787076090.071929:0:16041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787076090.071934:0:16041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a0b85 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.071942:0:16041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9961c1841e00/0x859911ad686a0b85 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14326 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076090.071944:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+20:14482:x1873884678845184:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 4950us (10113us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787076090.071961:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00010000:00010000:1.0:1787076090.071962:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787076090.071966:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787076090.071968:0:14326:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787076090.071969:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787076090.257472:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076090.257527:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076090.257584:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076090.257609:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076090.257623:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076090.257636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076090.257693:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076090.257708:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076090.257759:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678845312 00000100:00100000:0.0:1787076090.257769:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678845312 00000100:00100000:0.0:1787076090.257836:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678845568 00000100:00100000:1.0:1787076090.257839:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678845440 00000100:00100000:0.0:1787076090.257840:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678845568 00000100:00100000:1.0:1787076090.257848:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678845440 00000100:00100000:0.0:1787076090.257862:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678845696 00000100:00100000:0.0:1787076090.257868:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678845696 00000100:00100000:1.0:1787076090.257879:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678845952 00000100:00100000:1.0:1787076090.257885:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678845952 00000100:00100000:0.0:1787076090.257893:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678845824 00000100:00100000:0.0:1787076090.257899:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678845824 00000100:00100000:1.0:1787076090.257909:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678846080 00000100:00100000:1.0:1787076090.257915:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678846080 00000100:00100000:0.0:1787076090.257926:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678846208 00000100:00100000:0.0:1787076090.257932:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678846208 00000100:00100000:1.0:1787076090.257950:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:1.0:1787076090.257962:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+14:2362:x1873884678845312:12345-192.168.204.50@tcp:4:dd.0 00000100:00100000:2.0:1787076090.257974:0:15013:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787076090.257996:0:15013:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00002000:00010000:1.0:1787076090.258025:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a849df9, atime: 0x6a849df8, ctime: 0x6a849df9, blocks: 0x1 00010000:00010000:1.0:1787076090.258039:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0b8c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.258058:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787076090.258064:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076090.258081:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0b8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.258102:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0b8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076090.258968:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:0.0:1787076090.258985:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+14:2362:x1873884678845568:12345-192.168.204.50@tcp:4:dd.0 00010000:00010000:0.0:1787076090.259012:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0b93 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076090.259027:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076090.259031:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076090.259037:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0b93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076090.259050:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0b93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.313120:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787076090.388227:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1787076090.388265:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:0.0:1787076090.388273:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:1.0:1787076090.388426:0:15012:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:1.0:1787076090.388430:0:15012:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787076089 -> 1787076090 00002000:00010000:1.0:1787076090.388434:0:15012:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787076089 -> 1787076090 00002000:00010000:1.0:1787076090.388436:0:15012:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1787076090.388451:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0b8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.388470:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0b8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.388480:0:15012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0b8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.388488:0:15012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038000 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787076090.388494:0:15012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0b8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.388590:0:15012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0b8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.388612:0:15012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0b8c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.388661:0:15012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0b8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076090.388989:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+15:2362:x1873884678845312:12345-192.168.204.50@tcp:4:dd.0 Request processed in 131024us (131523us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787076090.389001:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:1.0:1787076090.389037:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:1.0:1787076090.389050:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+14:2362:x1873884678845440:12345-192.168.204.50@tcp:4:dd.0 00010000:00010000:1.0:1787076090.389087:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078f805f9/0x859911ad686a0b9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.389101:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076090.389105:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076090.389112:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078f805f9/0x859911ad686a0b9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.389124:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078f805f9/0x859911ad686a0b9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787076090.435107:0:15014:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:2.0:1787076090.435133:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0b93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.435150:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0b93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.435159:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0b93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.435188:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125ca00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076090.435192:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0b93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.435200:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0b93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.435223:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0b93 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.435231:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7517090/0x859911ad686a0b93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076090.435400:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+16:2362:x1873884678845568:12345-192.168.204.50@tcp:4:dd.0 Request processed in 176414us (177866us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787076090.435418:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:2.0:1787076090.435454:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:2.0:1787076090.435468:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+15:2361:x1873884678845696:12345-192.168.204.50@tcp:4:dd.0 00000001:00080000:0.0:1787076090.437241:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00010000:00010000:2.0:1787076090.438473:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff2d8e6f/0x859911ad686a0ba1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.438510:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787076090.438516:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787076090.438523:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff2d8e6f/0x859911ad686a0ba1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.438558:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff2d8e6f/0x859911ad686a0ba1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787076090.483630:0:15012:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1787076090.483651:0:15012:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1787076090.483667:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078f805f9/0x859911ad686a0b9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.483683:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078f805f9/0x859911ad686a0b9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.483707:0:15012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078f805f9/0x859911ad686a0b9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.483726:0:15012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038c00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787076090.483732:0:15012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078f805f9/0x859911ad686a0b9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.483740:0:15012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078f805f9/0x859911ad686a0b9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.483760:0:15012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078f805f9/0x859911ad686a0b9a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.483768:0:15012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078f805f9/0x859911ad686a0b9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076090.483859:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+15:2362:x1873884678845440:12345-192.168.204.50@tcp:4:dd.0 Request processed in 94809us (226279us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787076090.483869:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:1.0:1787076090.483904:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:1.0:1787076090.483915:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+14:2361:x1873884678845952:12345-192.168.204.50@tcp:4:dd.0 00010000:00010000:1.0:1787076090.483946:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0ba8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.483958:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076090.483968:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787076090.483975:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0ba8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.483988:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0ba8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787076090.488027:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000001:00080000:0.0:1787076090.561489:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:0.0:1787076090.562354:0:15014:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:0.0:1787076090.562369:0:15014:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1787076090.562387:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff2d8e6f/0x859911ad686a0ba1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076090.562400:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff2d8e6f/0x859911ad686a0ba1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076090.562410:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff2d8e6f/0x859911ad686a0ba1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076090.562418:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1840600 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787076090.562423:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff2d8e6f/0x859911ad686a0ba1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076090.562433:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff2d8e6f/0x859911ad686a0ba1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076090.562455:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff2d8e6f/0x859911ad686a0ba1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076090.562486:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff2d8e6f/0x859911ad686a0ba1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076090.562596:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+12:2361:x1873884678845696:12345-192.168.204.50@tcp:4:dd.0 Request processed in 127129us (304981us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787076090.562607:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:0.0:1787076090.562679:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:0.0:1787076090.562693:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+11:2361:x1873884678845824:12345-192.168.204.50@tcp:4:dd.0 00010000:00010000:0.0:1787076090.562736:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0baf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076090.562749:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076090.562754:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076090.562760:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0baf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076090.562773:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0baf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787076090.611915:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:2.0:1787076090.612035:0:15012:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:2.0:1787076090.612053:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0ba8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.612066:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0ba8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.612075:0:15012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0ba8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.612083:0:15012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff996190038000 already unused, calling callback (ffffffffc1593010) 00010000:00010000:2.0:1787076090.612088:0:15012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0ba8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.612098:0:15012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0ba8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.612119:0:15012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0ba8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.612125:0:15012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000896c5564/0x859911ad686a0ba8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787076090.612250:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+11:2361:x1873884678845952:12345-192.168.204.50@tcp:4:dd.0 Request processed in 128333us (354621us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1787076090.612262:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:2.0:1787076090.612294:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:2.0:1787076090.612305:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+10:2361:x1873884678846080:12345-192.168.204.50@tcp:4:dd.0 00010000:00010000:2.0:1787076090.612337:0:15012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce511c79/0x859911ad686a0bb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.612349:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787076090.612353:0:15012:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787076090.612373:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce511c79/0x859911ad686a0bb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787076090.612385:0:15012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce511c79/0x859911ad686a0bb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787076090.660656:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:0.0:1787076090.666145:0:15014:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1787076090.666155:0:15014:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:0.0:1787076090.666171:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0baf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076090.666208:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0baf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076090.666218:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0baf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076090.666226:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125d800 already unused, calling callback (ffffffffc1593010) 00010000:00010000:0.0:1787076090.666231:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0baf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076090.666240:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0baf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076090.666261:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0baf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076090.666268:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b894d7f6/0x859911ad686a0baf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787076090.666369:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+10:2361:x1873884678845824:12345-192.168.204.50@tcp:4:dd.0 Request processed in 103676us (408727us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787076090.666380:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:0.0:1787076090.666414:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:0.0:1787076090.666427:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b9df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+9:2361:x1873884678846208:12345-192.168.204.50@tcp:4:dd.0 00010000:00010000:0.0:1787076090.666458:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0bbd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076090.666477:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076090.666481:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787076090.666488:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0bbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787076090.666499:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0bbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787076090.700670:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:1.0:1787076090.701085:0:15012:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:1.0:1787076090.701103:0:15012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce511c79/0x859911ad686a0bb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.701116:0:15012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce511c79/0x859911ad686a0bb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.701125:0:15012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce511c79/0x859911ad686a0bb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.701132:0:15012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9961c1841400 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787076090.701138:0:15012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce511c79/0x859911ad686a0bb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.701146:0:15012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce511c79/0x859911ad686a0bb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.701165:0:15012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce511c79/0x859911ad686a0bb6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.701193:0:15012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce511c79/0x859911ad686a0bb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076090.701288:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+9:2361:x1873884678846080:12345-192.168.204.50@tcp:4:dd.0 Request processed in 88981us (443590us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787076090.701299:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000001:00080000:0.0:1787076090.733970:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:1.0:1787076090.734342:0:15014:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1787076090.734360:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0bbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.734374:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0bbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.734384:0:15014:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0bbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.734392:0:15014:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99608125da00 already unused, calling callback (ffffffffc1593010) 00010000:00010000:1.0:1787076090.734457:0:15014:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0bbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.734469:0:15014:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0bbd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.734494:0:15014:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0bbd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787076090.734519:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001076e3f1/0x859911ad686a0bbd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787076090.734735:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b9df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68657535-b9e1-4ead-a295-31f2243e0fc4+5:2361:x1873884678846208:12345-192.168.204.50@tcp:4:dd.0 Request processed in 68308us (477021us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787076090.734747:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:1.0:1787076091.080030:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b4d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700843648:0@lo:400:kworker.0 00000100:00100000:1.0:1787076091.080118:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076091.080187:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b4d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700844160:0@lo:400:kworker.0 00000100:00100000:1.0:1787076091.080213:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076091.080250:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787076091.080257:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b4d1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51646941-6761-4bd4-bf4b-97125ced6c1b:3312:1873884700843520:0@lo:400:kworker.0 00000100:00100000:1.0:1787076091.080284:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076091.080305:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b4d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700844032:0@lo:400:kworker.0 00000100:00100000:1.0:1787076091.080326:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787076091.080367:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700843648 00000100:00100000:1.0:1787076091.080375:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700843648 00000100:00100000:1.0:1787076091.080430:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787076091.080439:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700843648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787076091.080501:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1873884700843648:12345-0@lo:400:kworker.0 Request processed in 63us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076091.080508:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787076091.080531:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700844160 00000100:00100000:1.0:1787076091.080534:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700844160 00000100:00100000:1.0:1787076091.080581:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700844032 00000100:00100000:1.0:1787076091.080585:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700844032 00000100:00100000:1.0:1787076091.080606:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787076091.080612:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700844160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787076091.080668:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873884700844160:12345-0@lo:400:kworker.0 Request processed in 56us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076091.080675:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787076091.080691:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787076091.080697:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bec08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700844032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787076091.080724:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bec08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873884700844032:12345-0@lo:400:kworker.0 Request processed in 28us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076091.080729:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787076091.080746:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787076091.080750:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787076091.080781:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b4d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1873884700844032:0@lo:400:kworker.0 00000100:00100000:1.0:1787076091.080792:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b4d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1873884700843648:0@lo:400:kworker.0 00000100:00100000:1.0:1787076091.080799:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b4d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1873884700844160:0@lo:400:kworker.0 00000100:00100000:0.0:1787076091.081173:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700843520 00000100:00100000:0.0:1787076091.081178:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700843520 00000100:00100000:0.0:1787076091.081215:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787076091.081223:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+19:3312:x1873884700843520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787076091.081361:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51646941-6761-4bd4-bf4b-97125ced6c1b+19:3312:x1873884700843520:12345-0@lo:400:kworker.0 Request processed in 139us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076091.081368:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787076091.081700:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b4d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700843776:0@lo:400:kworker.0 00000100:00100000:3.0:1787076091.081742:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787076091.081776:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787076091.081783:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961b4d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700843904:0@lo:400:kworker.0 00000100:00100000:3.0:1787076091.081807:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076091.082016:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700843904 00000100:00100000:2.0:1787076091.082021:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700843904 00000100:00100000:2.0:1787076091.082053:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787076091.082060:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700843904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787076091.082104:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1873884700843904:12345-0@lo:400:kworker.0 Request processed in 44us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076091.082111:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787076091.082154:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b4d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1873884700843904:0@lo:400:kworker.0 00000100:00100000:2.0:1787076091.082194:0:3313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9961c1883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700844288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787076091.082231:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787076091.082259:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700844288 00000100:00100000:2.0:1787076091.082263:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700844288 00000100:00100000:2.0:1787076091.082295:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787076091.082302:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961bf778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700844288:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787076091.082321:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787076091.082451:0:15009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884700843776 00000100:00100000:0.0:1787076091.082455:0:15009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884700843776 00000100:00100000:0.0:1787076091.082631:0:15009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787076091.082660:0:15009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961c1881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1873884700843776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787076091.082704:0:15009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961c1881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1873884700843776:12345-0@lo:400:kworker.0 Request processed in 66us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076091.082711:0:15009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787076091.082807:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b4d1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51646941-6761-4bd4-bf4b-97125ced6c1b:3312:1873884700843520:0@lo:400:kworker.0 00000100:00100000:1.0:1787076091.082841:0:3313:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1787076091.082846:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9961a6e45180, transno 8589934595 00000004:00080000:1.0:1787076091.082865:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1787076091.082886:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961b4d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700843776:0@lo:400:kworker.0 00002000:00000024:2.0:1787076091.083653:0:15010:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:2.0:1787076091.084008:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961bf778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1873884700844288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1480us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076091.084018:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787076091.084422:0:3313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9961c1883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1873884700844288:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787076091.335953:0:14313:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787076092.342863:0:16608:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1787076092.364612:0:16041:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787076092.706568:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076092.706615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787076092.706852:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678846336 00000100:00100000:2.0:1787076092.706862:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678846336 00000100:00100000:2.0:1787076092.706914:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 123 00000100:00100000:2.0:1787076092.706924:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff996184e9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b749548-aa04-4561-b46c-adb589deaa28+13:2362:x1873884678846336:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787076092.707007:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff996184e9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b749548-aa04-4561-b46c-adb589deaa28+13:2362:x1873884678846336:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 84us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076092.707015:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 123 00000100:00100000:1.0:1787076092.707347:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678846592 00000100:00100000:1.0:1787076092.707352:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678846592 00000100:00100000:1.0:1787076092.707413:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:1.0:1787076092.707421:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+5:2362:x1873884678846592:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787076092.707462:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68657535-b9e1-4ead-a295-31f2243e0fc4+5:2362:x1873884678846592:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 41us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787076092.707468:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:0.0:1787076092.707684:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076092.707735:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076092.707767:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076092.707784:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076092.707802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787076092.707819:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678847104 00000100:00100000:0.0:1787076092.707823:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678847104 00000100:00100000:0.0:1787076092.707844:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678846720 00000100:00100000:0.0:1787076092.707846:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678846720 00000100:00100000:0.0:1787076092.707856:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678846976 00000100:00100000:0.0:1787076092.707858:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678846976 00000100:00100000:0.0:1787076092.707870:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:0.0:1787076092.707877:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:703f1470-5b22-4bd9-b310-b8043c4ba269+5:2362:x1873884678847104:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787076092.707910:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:703f1470-5b22-4bd9-b310-b8043c4ba269+5:2362:x1873884678847104:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 33us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076092.707917:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:0.0:1787076092.707928:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:0.0:1787076092.707934:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+5:2362:x1873884678846720:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787076092.707959:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68657535-b9e1-4ead-a295-31f2243e0fc4+5:2362:x1873884678846720:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 25us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076092.707965:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:0.0:1787076092.707989:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:0.0:1787076092.707996:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:703f1470-5b22-4bd9-b310-b8043c4ba269+5:2362:x1873884678846976:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787076092.708032:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:703f1470-5b22-4bd9-b310-b8043c4ba269+5:2362:x1873884678846976:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 36us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787076092.708238:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00080000:2.0:1787076092.708484:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787076092.708489:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787076092.708501:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678846848 00000100:00100000:2.0:1787076092.708506:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678846848 00000100:00100000:2.0:1787076092.708559:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873884678846464 00000100:00100000:2.0:1787076092.708563:0:15531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873884678846464 00000100:00100000:2.0:1787076092.708581:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:2.0:1787076092.708587:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:703f1470-5b22-4bd9-b310-b8043c4ba269+6:2362:x1873884678846848:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787076092.708628:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:703f1470-5b22-4bd9-b310-b8043c4ba269+6:2362:x1873884678846848:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 40us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076092.708663:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:2.0:1787076092.708677:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:2.0:1787076092.708684:0:15531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9961b4d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+20:2362:x1873884678846464:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787076092.708712:0:15531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9961b4d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68657535-b9e1-4ead-a295-31f2243e0fc4+20:2362:x1873884678846464:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 30us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787076092.708718:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00080000:0.0:1787076092.708932:0:14320:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787076093.384008:0:14312:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29332 lines, 29332 kept, 0 dropped, 0 bad.